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INTRODUCTION 

Explanation  of  Evaluation  Project  -  This  Users'  Guide  demonstrates  five  ways  to 
evaluate  your  communicable  disease  programs  —  from  a  cost-efficient  reporting 
system  to  program  and  outbreak  cost  analyses.   The  evaluation  methodologies 
are  a  result  of  the  two-year  Community  Health  Services  Evaluation  and  Planning 
Project,  conducted  from  1979  to  1981  by  the  Missoula  City-County  Health  Depart- 
ment. 

The  goal  of  the  evaluation  project  is  to  provide  public  health  program 
administrators  with  practical,  efficient  evaluation  methods  that  they  could 
apply  to  their  department's  program.   The  result  of  that  goal  is  this  Users' 
Guide. 

Scope  of  Communicable  Disease  Evaluation  -  This  evaluation  covers  a  representative 
sample  of  five  diseases: 

•  Measles 

•  Tuberculosis 

•  Hepatitis  A 

•  Salmonella 

•  Giardia 

Public  health  departments  are  responsible  for  such  a  great  number  of  com- 
municable diseases  —  from  Amebiasis  to  Whooping  Cough  —  that  an  evaluation 
could  not  cover  more  than  a  few.   This  sample  represents  differing  epidem- 
iologies and  surveillance  procedures. 

Each  evaluation  methodology  is  designed  to  smoothly  fit  into  your  health 
department's  existing  programs  and  to  produce  clear  and  immediately  useful 
data.  Because  the  Missoula  Health  Department  was  the  test  site  for  this 
evaluation  model,  the  examples  shown  in  this  Guide  are  based  on  Missoula's 
programs  and  data.  You  may  need  to  modify  some  parts  of  the  evaluation  to 
fit  your  programs'  features,  or  expand  the  evaluation  to  other  disease  programs. 

Each  section  of  the  Guide  shows  Missoula's  test  results,  discusses  evaluation 
procedures,  reviews  evaluation  models,  and  provides  any  forms  used  to  collect 
data.   Program  cost  analysis  worksheets,  communicable  disease  reporting  forms 
and  other  documents  are  copy-ready. 

Changes  from  Original  Evaluation  Plan  -  An  evaluation  plan  is  a  brief  outline 
of  proposed  work.   Several  parts  of  the  Communicable  Disease  Evaluation  Plan 
proved  to  'ne    infeasible,  so  were  dropped  and  other  parts  were  changed: 

1.   Evaluation  Objective  1,  School  Immunization  Law  data  — Figures  are 
not  consistent  from  year  to  year.   The  law  changed  in  1981,  making 
earlier  data  inconclusive.   Dropped. 


Evaluation  Objective  3,  Test  of  Three  Reporting  Options,  Four 
Experimental  Groups  of  Physicians  —  Changed  to  one  reporting  system 
which  incorporates  telephone,  mail,  and  computer  reports  from  three 
different  groupings  of  physicians. 

Evaluation  Objective  A,  Cost/Benefit  of  Communicable  Disease 
Programs  —  The  Center  for  Disease  Control  in  Atlanta  does  not  have 
cost/benefit  data  for  the  five  diseases  this  evaluation  covers. 
Some  Information  is  available  about  the  costs  of  outbreaks  (especially 
salmonella),  but  straight  cost/benefit  Information  is  rare.  Authors 
do  not  like  putting  costs  on  health  or  human  lives.  Dropped. 
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Section  1 

communicable  disease  reporting  - 
an  effective  and  cost-effective  system 

Results  -  Communicable  Disease  Reporting  in  Missoula  County  increased  from  an 
estimated  S0%   with  the  old,  passive  system  to  85%  with  the  new,  active  reporting 
system.   In  addition,  health  department-physician  relations  are  markedly  im- 
proved.  The  Department  strengthened  its  surveillance  procedures  and  reaction 
time  significantly. 

The  Missoula  Health  Department,  like  many  other  public  health  agencies, 
previously  had  a  passive  reporting  system.   It  was  common  to  hear  about 
cases  of  communicable  diseases  through  the  medical  grapevine  days  or  weeks 
after  diagnosis.   While  asking  physicians  about  the  old  reporting  system, 
many  admitted  they  did  not  report  communicable  diseases  and  some  were  not 
familiar  with  reporting  procedures  at  all. 

Estimated  Costs  Based  on  Missoula's  Program  -  These  costs  represent  .5%  of 
Missoula's  total  yearly  budget  and  are  based  on  103  regularly  reporting 
physicians  (mail  and  telephone  reporters)  (or  52  physicians'  offices). 

Regular  (Not  Start-Up)  Costs 

Personnel:  Director  @  7  hrs/mo.  $100 
Coordinator  @  ^0  hrs/mo.  AOO 
Assistant  @  28  hrs/mo.      150 

(Total  75  hrs/mo.)         $650 

Postage/     Reminder  Post  Cards/mo.  $  15 
Printing:    Physicians  Bulletin 

1/mo.  unless  special  case  20 

Printing-forms/mo.  cost    5_ 

$  ko 

Total  monthly  average  cost  $690 

Discussion  -  The  active  reporting  system  was  specifically  designed  to  overcome 
past  problems  with  reporting,  yet  be  cost-effective.  The  most  important  parts 
of  this  system  are: 

1.  Office  personnel,  not  physicians,  are  asked  to  report. 

2.  A  combination  of  telephone  and  mail  reporters. 

3.  Direct  feedback  to  physicians  and  their  staffs  through  the  monthly 
"Physician  Bui letin." 
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The  ideal  reporting  system  would  be  to  telephone  each  physician's  office 
weekly.   This  reporting  system  recognizes  that  public  health  departments  do 
not  have  enough  personnel  nor  money  to  support  that  type  of  reporting,  so 
the  design  calls  for  the  majority  of  staff  time  to  be  spent  collecting  data 
from  reporters  who  see  the  majority  of  reportable  diseases.   Proportionally 
less  staff  time  is  spent  collecting  mail  reports  from  physicians  who  are 
less  likely  to  see  substantial  numbers  of  communicable  diseases. 

School  absentee  rate  reporting  can  act  as  a  back-up  by  giving  advance  warning 
of  outbreaks,  especially  influenza. 

Initially,  the  reporting  system  took  substantial  amounts  of  time  as  health 
department  staff  visited  each  doctor's  office  to  explain  the  system  and 
distribute  forms  and  disease  lists.   Increased  physician/staff-health 
department  cooperation  and  rapport,  however,  was  worth  the  extra  effort. 

Recommendations  -  (1)  Maintain  close  contact  with  physicians  and  their  staffs 
and  ask  for  their  feedback  regularly,  (2)  send  the  Physician  Bulletin  out 
promptly,  (3)  hold  regular  communicable  disease  reporting  team  meetings  and 
training,  {k)    send  post  card  reminders  to  mail  reporters  with  funny  quotes 
("Murphy's  Laws  and  Corollaries"  are  good)  to  insure  that  office  personnel 
remember  to  report  each  week,  (5)  send  each  school  a  copy  of  their  absentee 
rate  data  (so  they  know  you  actually  use  their  information),  and  (6)  do 
not  have  an  outbreak  when  you  just  begin  your  new  reporting  system  —  it 
can  be  very  confusing. 

Methodology  -  Procedures  and  forms  may  be  used  either  as  they  appear,  as 
examples,  or  modified  to  fit  your  individual  program. 

1.  Reporting  Protocol  — The  blue-print  of  the  reporting  system.  All  staff 

should  thoroughly  understand  reporting  procedures. 
(Pages  l.^to  l.lO) 

2.  Reporting  Forms  — To  be  filled  out  daily  by  physician's  office  personnel. 

(Note  that  "Immediately  Reportable  Diseases"  are  phoned 
to  the  health  department  within  24  hours  of  diagnosis.) 
The  form  Is  designed  to  be  folded  and  mailed  to  the 
health  department  address  pre-printed  on  the  back. 
(Page  1.11) 

3.  List  of  Reportable  Diseases  —  Should  comply  with  the  State  Department 

of  Health  and  Environmental  Science's  regulations. 
Missoula's  list  also  reflect  some  local  requirements. 
(Page  1.12) 

k.      Reminder  Post  Card  —  Sent  to  each  mall  reporter  weekly.  We  recommend 
printing  funny  sayings  on  the  cards  to  Insure  nurses 
or  receptionists  notice  each  card  and  remember  to  report 
(Example  page  1.13) 
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5.  Physician  Bulletin  —Mailed  to  all  reporting  physicians  and  their  staffs 

at  least  nxsnthly.   Should  be  short  and  easy  to  skim 
and  reflect  local  physicians'  information  desires. 
Physicians  report  they  are  inundated  with  dally  mail 
and  will  read  only  relevant  and  concise  pieces. 
(Example  page  1 .  lA) 

6.  Letter  Announcing  New  Reporting  System  —  Sent  to  all  physicians  in  the 

community  who  will  see  cases  of  communicable  diseases 
on  a  fairly  regular  basis.  The  letter  announces  that 
the  reporting  procedure  is  being  changed  and  lets  the 
physicians  and  their  staffs  know  that  a  Health  Department 
representative  will  be  coming  to  see  them.   (Page  1 .  >5  to  1.16] 

7.  Letter  to  Specialists  —This  letter  goes  to  dentists,  radiologists,  surgeons, 

podiatrists  and  other  specialists  who  are  very  unlikely 
to  see  cases  of  communicable  diseases.  The  letter  lets 
them  know  they  are  expected  to  report,  but  recognizes 
that  they  probably  will  not  see  any  reportable  diseases. 
(Page  1.17) 

8.  "How  to  Report"  Instructions  —  At  least  one  copy  to  each  reporting  office 

within  one  month  after  a  personal  visit  from  a  Health 
Department  representative.  The  instructions  remind 
offices  to  report  and  serve  to  further  clarify  procedures. 
Since  physicians'  offices  have  a  fairly  high  staff  turn- 
over, sending  out  new  copies  each  six  months  is  helpful. 
(Page  1.l8  to  1.19) 

g.  Communicable  Disease  Case  Study  Record  —  Form  filled  out  by  the  Communicable 
Disease  Assistant  after  receiving  a  communicable  disease 
report  and  given  to  the  Coordinator  for  investigation  and 
followup.   (Page  1.20) 

10.  "Contagious  Communique"  —  Form  completed  if  someone  other  than  the  Communicable 

Disease  Assistant  receives  a  telephone  report  of  a 
communicable  disease.   It  is  to  be  routed  to  the  Assistant 
immediately.   (Page  1.21) 

11.  Communicable  Disease  Logs  —Three  logs  which  record  all  incoming  reports. 

(l)  The  Communicable  Disease  Log  is  a  central  record 
of  all  diseases  reported  to  the  health  department  and 
their  outcome.   (2)  The  Telephone  Log  is  a  brief  record 
of  weekly  calls  made  by  the  health  department  to  phone 
reporters.   (3)  The  Mail  Log  is  a  brief  record  of  weekly 
reports  by  reporters  who  mail  in  their  communicable  disease 
logs.   (Pages  1 .22  to  1 .2^) 
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COMMUNICABLE  DISEASE 
REPORTING  PROTOCOL 


PROGRAM  DESCRIPTION 

Montana  physicians  are  to  promptly  report  cases  of  communicable  disease  to 
the  Health  Department  (Section  50-1-202(19)  MCA).  Historically,  the  level  of 
communicable  disease  (CD)  reporting  has  been  low  and  it  is  generally  acknowledged 
that  the  currently  used,  passive  system  does  not  give  an  accurate  count  of 
disease  incidence.  Better  success  has  been  realized  by  variations  of  an 
active  system  when  the  Health  Department  takes  an  active  role  in  contacting 
physicians'  offices. 

Reporting  procedures  are  specialized  for  each  of  three  types  of  physicians' 

offices: 

Group  I:  Approximately  two-thirds  of  the  physicians'  offices 
will  be  provided  with  reporting  forms  (Appendix  A)  to 
be  filled  out  daily  and  mailed  to  the  Health  Department 
at  the  end  of  the  reporting  week  (defined  as  Tuesday 
to  Monday).  Large  clinics  may  report  weekly  by 
providing  a  copy  of  their  computer  weekly  reports. 

Group  II:  Approximately  one-third  of  the  physicians,  known  as 
Index  Physicians,  will  be  telephoned  each  Tuesday 
for  their  weekly  report.  This  group  represents  a 
cross-section  of  doctors  most  likely  to  see  significant 
numbers  of  reportable  communicable  diseases. 

Group  III:  The  remainder  (surgeons,  radiologists,  dentists,  etc.) 
will  be  sent  a  letter  with  a  list  of  reportable 
diseases  and  requested  to  call  the  Health  Department 
if  they  should  diagnose  a  reportable  communicable 
disease.  No  attempts  will  be  made  to  continue 
active  contact  with  this  group  because  of  the 
improbability  of  their  seeing  cases  of  reportable 
diseases. 

Lists  of  reporters  are  compiled  on  a  "physician  unit"  concept,  i.e.,   if  three 
physicians  practice  together  and  have  the  same  office  staff,  then  all  three  will 
be  considered  to  be  one  physician  unit,  while  10  physicians  who  practice  in  a 
clinic  and  have  separate  office  staffs  will  be  considered  10  physician  units. 
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The  list  of  Group  I  and  II  primary  reporters  includes: 


t  internists 

•  general  practitioners 

•  gynecologists/obstetricians 

0  pediatricians 

0  hematologists/oncologists 

0  dermatologists 

0  urologists 

0  ear,  nose  and  throat  specialists 

The  li 

St  of  Group 

III  reporters  includes*: 

0  surgeons 

0  allergists 

0  anethesiologists 

0  optometrists/opthamologists 

0  psychiatrists/psychologists 

0  cardiovascular  physicians 

0  radiologists 

0  dentists 

0  neurologists 

0  orthopedic  specialists 

0  podiatrists 

PROCEDURES 

Group 

1- 

Mail  a 

letter  to  Group  I  physicians  tell 

ing 

ing  system  (letter  sample  1.15—1.16).  Make  initial  visits  to  each  physician  unit 
in  Group  I  and  II  to  explain  the  reporting  procedure  and  make  arrangements  to 
begin  the  system.  The  visit  has  three  purposes  --  first,  to  follow  up  the  letter 
in  order  to  stress  the  importance  of  the  reporting  system;  second,  to  answer 
any  questions  and  iron  out  any  problems;  and  third,  to  record  the  name  of  the 
staff  member  who  will  be  responsible  for  actual  reporting  (usually  the  office 
nurse  or  receptionist).  Provide  each  office  with  at  least  one  list  of  report- 
able diseases  and  a  supply  of  reporting  forms. 

Each  physician  unit  in  Group  I  is  responsible  for  completing  a  reporting  form 
each  week  (the  reporting  week  is  defined  as  Tuesday  through  Monday  to  avoid 
busiest  days  and  times  physicians  offices  may  be  closed)  and  mailing  it  to  the 
Health  Department.  The  reporting  form  is  constructed  so  that  it  may  be  folded 
in  three  parts,  stapled,  stamped  and  mailed  to  the  address  pre-printed  on  the  back. 


Physicians  who  praotioe  more  than  specialties   listed  in  Group  III  may  be  %:: 

included  in  Group  I  or  II  because  they  also  practice  internal  medicine,   etc. 
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The  Health  Department  CD  Assistant  (or  backup)  will  be  responsible  for  compiling 
all  incoming  data  in  a  log  and  forwarding  reports  to  the  CD  Coordinator  by  10:00 
Friday  morning.  The  Coordinator  will  then  assign  followup  to  nurses  and/or 
sanitarians  as  necessary.  In  addition,  the  CD  Assistant  will  take  phoned 
reports  of  Immediately  Reportable  Diseases  and  give  them  to  the  Coordinator 
(or  backup)  within  one  hour  for  followup. 

Group  II  -  Send  a  letter  explaining  the  reporting  system  to  each  physician  in 
Group  II  and  ask  them  to  assign  a  doctor's  assistant  or  nurse  to  take  the  telephone 
call  from  the  Health  Department  each  Tuesday.  Make  a  personal  visit  to  further 
familiarize  the  office  staff  with  the  reporting  procedures.  Be  sure  each  office 
has  at  least  one  list  of  reportable  diseases  and  knows  the  reporting  procedure. 
Group  II  will  be  responsible  for  calling  the  Health  Department  immediately  after 
diagnosing  an  Immediately  Reportable  Disease. 

The  CD  Assistant  will  call  each  physician  unit  Tuesday  morning  and  ask  for 
their  communicable  disease  report  for  the  preceeding  week.  Record  the  results  of 
the  calls  in  the  CD  Log  and  give  disease  reports  to  the  CD  Coordinator  by  10:00 
Friday  morning  for  review  and  assignment. 

Group  III  -  According  to  health  professionals,  this  group  of  physicians  is 
unlikely  to  provide  primary  care  for  communicable  diseases,  so  efficiency  demands 
that  resources  be  used  for  Groups  I  and  II.  Send  a  letter  to  physicians  in 
this  group  (letter  sample  page  1.17)  reminding  them  to  report  communicable 
diseases  should  they  see  any  on  the  list  of  reportable  diseases  included  with 
the  letter.  Group  III  will  report  directly  to  the  Health  Department  by  phone. 
The  CD  Assistant  will  be  responsible  for  receiving  those  calls  and  routing 
routine  reports  to  the  CD  Coordinator  by  10:00  Friday  morning  or  Immediately 
Reportable  Diseases  to  the  Coordinator  within  one  hour. 

HEALTH  DEPARTMENT  INTERNAL  PROCEDURES 

The  following  flow  charts  show  the  communicable  disease  reporting  process  for: 
(1)  routine  mailed  reports,  (2)  routine  telephone  reports,  and  (3)  Immediately 
Reportable  Disease  reports.  Staff  responsibilities  and  time  frames  are  included. 
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The  list  of  Group  I  and  II  primary  reporters  includes: 

•  internists 

•  general  practitioners 

•  gynecologists/obstetricians 
t  pediatricians 

t  hematologists/oncologists 

•  dermatologists 

•  urologists 

•  ear,  nose  and  throat  specialists 

The  list  of  Group  III  reporters  includes*: 

•  surgeons 

•  allergists 

•  anethesiologists 

t  optometrists/opthamologists 

•  psychiatrists/psychologists 
t  cardiovascular  physicians 

•  radiologists 
t  dentists 

t  neurologists 

t  orthopedic  specialists 

•  podiatrists 

PROCEDURES 

Group  I  -  Mail  a  letter  to  Group  I  physicians  telling  them  about  the  new  report- 
ing system  (letter  sample  1.15--1.16).  Make  initial  visits  to  each  physician  unit 
in  Group  I  and  II  to  explain  the  reporting  procedure  and  make  arrangements  to 
begin  the  system.  The  visit  has  three  purposes  --  first,  to  follow  up  the  letter 
in  order  to  stress  the  importance  of  the  reporting  system;  second,  to  answer 
any  questions  and  iron  out  any  problems;  and  third,  to  record  the  name  of  the 
staff  member  who  will  be  responsible  for  actual  reporting  (usually  the  office 
nurse  or  receptionist).  Provide  each  office  with  at  least  one  list  of  report- 
able diseases  and  a  supply  of  reporting  forms. 

Each  physician  unit  in  Group  I  is  responsible  for  completing  a  reporting  form 
each  week  (the  reporting  week  is  defined  as  Tuesday  through  Monday  to  avoid 
busiest  days  and  times  physicians  offices  may  be  closed)  and  mailing  it  to  the 
Health  Department.  The  reporting  form  is  constructed  so  that  it  may  be  folded 
in  three  parts,  stapled,  stamped  and  mailed  to  the  address  pre-printed  on  the  back. 


^ ~ 

Physicians  who  practice  more  than  specialties   listed  in  Group  III  may  be 

included  in  Group  I  or  II  because  they  also  practice  internal  medicine,   etc. 
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The  Health  Department  CD  Assistant  (or  backup)  will  be  responsible  for  compiling 
all  incoming  data  in  a  log  and  forwarding  reports  to  the  CD  Coordinator  by  10:00 
Friday  morning.  The  Coordinator  will  then  assign  followup  to  nurses  and/or 
sanitarians  as  necessary.  In  addition,  the  CD  Assistant  will  take  phoned 
reports  of  Immediately  Reportable  Diseases  and  give  them  to  the  Coordinator 
(or  backup)  within  one  hour  for  followup. 

Group  II  -  Send  a  letter  explaining  the  reporting  system  to  each  physician  in 
Group  II  and  ask  them  to  assign  a  doctor's  assistant  or  nurse  to  take  the  telephone 
call  from  the  Health  Department  each  Tuesday.  Make  a  personal  visit  to  further 
familiarize  the  office  staff  with  the  reporting  procedures.  Be  sure  each  office 
has  at  least  one  list  of  reportable  diseases  and  knows  the  reporting  procedure. 
Group  II  will  be  responsible  for  calling  the  Health  Department  immediately  after 
diagnosing  an  Immediately  Reportable  Disease. 

The  CD  Assistant  will  call  each  physician  unit  Tuesday  morning  and  ask  for 
their  communicable  disease  report  for  the  preceeding  week.  Record  the  results  of 
the  calls  in  the  CD  Log  and  give  disease  reports  to  the  CD  Coordinator  by  10:00 
Friday  morning  for  review  and  assignment. 

Group  III  -  According  to  health  professionals,  this  group  of  physicians  is 
unlikely  to  provide  primary  care  for  communicable  diseases,  so  efficiency  demands 
that  resources  be  used  for  Groups  I  and  II.  Send  a  letter  to  physicians  in 
this  group  (letter  sample  page  1.17)  reminding  them  to  report  communicable 
diseases  should  they  see  any  on  the  list  of  reportable  diseases  included  with 
the  letter.  Group  III  will  report  directly  to  the  Health  Department  by  phone. 
The  CD  Assistant  will  be  responsible  for  receiving  those  calls  and  routing 
routine  reports  to  the  CD  Coordinator  by  10:00  Friday  morning  or  Immediately 
Reportable  Diseases  to  the  Coordinator  within  one  hour. 

HEALTH  DEPARTMENT  INTERNAL  PROCEDURES 

The  following  flow  charts  show  the  communicable  disease  reporting  process  for: 
(1)  routine  mailed  reports,  (2)  routine  telephone  reports,  and  (3)  Immediately 
Reportable  Disease  reports.  Staff  responsibilities  and  time  frames  are  included. 
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backup  1 
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^^^!5^P  '  Notify  State 

^^^^^^^^^^  Hlth.  Dept. 

as  necessary 

(*To  insure  confidentiality,  all  STD  reports  will  be  immediately  routed  to  the  Out- 
patient Clinic  and  noted  in  the  log  by  case  number.) 
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Job  Description 

CD  Director 
-Has  over-all  responsibility  for  CD  reporting  system. 

-Given  report  each  week  of  number  of  cases  of  CD,  results  of  investigation. 
•Responsible  for  changes  in  policy  and  procedures  of  CD  reporting. 
■Reports  to  Board  of  Health,  Health  Officer  and  Medical  Consultant. 
-Cooperatively  assigns  investigative  staff  with  the  CD  coordinator  as  needed. 
■Responsible  to  make  policy  decisions  and  changes  in  cooperation  with  the  CD 
coordinator. 


Job  Description 

Medical  Consultant 
■Serves  as  general  advisor  to  CD  director  and  coordinator. 
■Available  for  consultation. 

■May  assist  with  writing  and/or  reviewing  physician  bulletin. 
-May  assist  with  physician  relations  and  compliance  with  system. 
■Will  be  given  weekly  CD  reports  for  review 


Job  Description 

CD  Coordinator 
-Has  thorough  knowledge  of  CD  and  epidemiology. 
■Responsible  for  collecting  reports  of  CD  and  assigning  them  for  investigation 

to  the  appropriate  Health  Department  division  and  for  accepting  and  analyzing 

returning  investigation  reports. 

-Report  to  the  CD  Director  on  a  regular  weekly  basis. 
-Writes  articles  for  the  physician  bulletin  as  necessary. 
-Responsible  to  see  that  the  physician  bulletin  is  compiled  and  mailed  out. 
-Responsible  for  answering  physicians'  questions  and  making  call-backs  as 

needed. 

-Responsible  to  make  policy  decisions  and  changes  jointly  with  CD  director. 
-Assigns  staff  to  the  reporting  program  in  cooperation  with  the  CD  director. 
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Job  Description 

CD  Assistant 
-Responsible  for  calling  physicians'  offices  each  Tuesday  for  their  CD 

report  of  the  preceeding  week. 
-Responsible  for  receiving  mailed  reports  of  CD,  logging  them  in,  and  giving 

them  to  the  CD  coordinator. 
-Receives  and  logs  in  "immediately  reportable  diseases"  from  physicians'  offices 

and,  within  one  hour,  gives  reports  to  CD  coordinator  or  backup. 
-Types,  prints  and  mails  reporting  reminders  to  Group  I  physicians. 
-Types,  prints,  and  mails  physician  bulletin  as  instructed  by  CD  coordinator. 
-May  compile  and  present  statistics  as  directed  by  CD  coordinator  or  director. 
-Other  duties  as  assigned. 
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MISSOULA  CITY-COUNTY  HEALTH  DEPARTMENT 

301  West  Alder 

Missoula,  MT  59801 

721-5700  ex  383 


It  is  the  responsibility  of  physicians  to  notify  the  Health  Department  of  reportable 
diseases  {Seation  50-1-202  (19)  MCA).  Help  us  to  help  you  protect  the  health  of  the 
community  by  your  prompt  reporting. 


Date 
Today 

Disease 

Patient  name,  address/phone 

Age 

Sex 

Date 
Onset 

H.D. 
followup? 
Comments     YES   NO 

Numbered 

Diseases: 

Chickenpox 
Influenza 

Diarrheal 

Ilns 

^ivised 

MCCHD 

lr/80 

Missoula 

^Diphtheria 

Hepatitis,   A   &  B 

Salmonella 

County 

Erjsephalitis 

^Measles 

Shigella 

Disease 

^Foodborne 

^Meningitis, 

* Syphilis 

Emphasis: 

Illness 

Bacterial 

TB 

Giardia 

Mumps 

Typhoid  Fever 

^Gonorrhea 

Rubella 

Others   (State  CD 
List) 

*  =  IMPORTANT. 

Report  by  phone  irrvr 

ediately\ 

-fr<?n4-^ 


bA6k  ^ 


o  c  2 
c  ro  — 


>  c 
3  —  — 

O  Q.  flJ 


il 
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MISSOULA 
CITY-COUNTY  HEALTH  DEPARTMENT 

Reportable  Diseases  and  Conditions 


These  oommuniadble  diseases  must  he  reported  to  the  Health  Departmevt 
at  least  weekly.     Important:   those  diseases  whiah  are  starred*  must 
be  reported  to  the  Health  Department  immediately  by  phone   (721-5700, 
ext.  383)  because  of  their  immediate  hazard  to  the  community  and  their 
potential  for  rapid  spread.      The  Health  Department  welcomes  reporting 
of  other  diseases  as  per  the  professional  judgment  of  the  medical 
community. 


Amoebiasis 
Anthrax 

*Botulism 
Brucellosis 

*Chancroid 
*Cholera 

*Diphtheria 

Encephalitis,  all  types 
I 
*Food-borne  Illness 

Giardiasis 
*Gonorrhea 
*Granulonia  Inguinale 

Hepatitis,  A  and  B 


Legionnaires'  Disease 
Leprosy 
Leptospirosis 
*Lymphogranuloma  Venerum 

Malaria 
*Measles 

Meningitis,  aseptic 
*Meningococcal  Disease 
*Meningitis,  bacterial 

(other  than  meningococcus) 

Mumps 

Orinthosis  (Psittacosis) 

Paratyphoid  Fever 
*P1ague 
*Poliomyelitis 

*Rabies,  animal  and  human,  if 

persons  given  anti -rabies 

vaccine  for  animal  bites 

*Relapsing  Fever,  louse-borne 

Rocky  Mountain  Spotted  Fever 

Rubella  (German  Measles) 


Salmonella 

Shigellosis  (Bacillary 

Dysentery) 
♦Smallpox 
*Syphilis 

Tetanus 

Trichinosis 

Tuberculosis 

Tularemia 
*Typhoid  Fever 
*Typhus,  louse-borne 

*Yellow  Fever 

Whooping  couqh-like 
illness  (Pertussis) 


Reportable  outbreaks  or  suspected  outbreaks  by  number  only 


» 


Chickenpox 

Epidemic  Gastroenteritis 
Epidemic  Kerato- 
conjunctivitis 

Influenza 


Nosocomial  Disease 
Pediculosis  (lice) 
Ringworm  ( Derma tophytosis] 


Scabies 

Streptococcal  Infections 

Suspected  Non-Polio 

Enteroviral  Infections 
Swimmers'  Itch 

Water-borne  Disease 
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'     i^^  MI6S0UtA  CllY-COUNIY  HEALTH  DEPARTMENT 

301  WEST  ALOER  STREET     AIISSOUM.AIT  5^601 

PHYSICIAN  BULLETIN 


The  purpose  of  this  bulletin  is  to  provide  up-to-date 
aommunioable  disease  information  to  physicians  interested 
in  local  trends  and  disease  oaourance.     The  Missoula  City- 
County  Health  Department  will  provide  this  service  as 
part  of  its  aommunioable  disease  reporting  system. 


The  surveillance  system  is  up  and  running  and  is  apparently  working  well. 
Thank  you  for  your  and  your  staff's  cooperation. 

As  a  point  of  clarification,  the  diarrheal  illness  category  should  include 
all  diarrheal  illnesses  including  those  associated  with  allergic  reactions. 

It  will  be  necessary  for  physicians  to  report  gonorrhea  cases  rather  than 
relying  on  lab  reports,  because  labs  do  not  have  patient  name  and  address 
and/or  phone  number.  The  Health  Department's  standard  followup  procedure 
on  gonorrhea  cases  starts  with  a  call  to  the  diagnosing  physician. 

CAMPYLOBACTER  FETUS  SSP  JEJUNI 

Within  a  period  of  less  than  two  months  (between  March  and  May)  Campylobacter 
fetus  ssp  jejuni   was  isolated  from  stools  of  10  patients  with  diarrheal  illness. 
One  additional  case  was  diagnosed  on  the  basis  of  household  contact  with  another 
case.  Contact  with  dogs  was  the  apparent  source  of  two  of  the  cases  and  a 
suspect  water  supply  was  involved  in  another.  Raw  milk  was  a  possible  factor 
in  one  case.  Three  cases  were  in  children;  the  remainder  were  adults  under 
the  age  of  50.  One  patient  has  an  auto- immune  condition  and  another  has  a 
wide  range  of  allergies  which  may  have  affected  the  severity  of  diarrheal 
illness  experienced. 

A  recent  study  of  Campy lobaater   infections  in  Colorado  identified  significant 
environmental  contact  in  about  half  of  the  cases.  CDC  reports  that  Campylobacter 
infections  have  been  as  common  as  those  of  Salmonella   and  shigella   and  should 
be  considered  as  a  possible  diagnosis  in  diarrheal  illness. 

Salmonella 

Six  Salmonella   isolations  were  made  in  the  past  week.  Investigation  of  the 
cases  is  not  complete,  but  raw  milk  may  be  a  factor. 


The  Health  Department  welcomes 

feedbadl:  oh  the  Physician  Bulletin 

in  the  form  of  comments ^  suggestions ^  /f 

and  additional  disease  information.  ^ 

Bill  DeCouir 
CD  Coordinator 


June  9,  1980 


.MAKIWG  A  DIFFERENCE . 


TO:   Missoula  Physicians 
FROM:  The  Missoula  City-County  Health  Department 
RE:  Reporting  of  Conmuni cable  Diseases 


In  order  to  make  it  easier  for  Missoula  physicians  to  meet  requirements  for 
reporting  communicable  diseases,  the  Health  Department  is  changing  reporting 
procedures.  Your  office  will  be  asked  to  daily  fill  out  a  brief  reporting 
sheet  (copy  attached)  which  was  designed  to  replace  the  current  yellow  cards. 
At  the  end  of  the  reporting  week  (Tuesday  to  Monday),  your  office  will  be  sent 
a  post  card  reminder  to  mail  the  sheet  to  the  Health  Department.  We  ask  that 
you  report  diseases  posing  an  immediate  hazard  to  the  community  to  the  Department 
immediately  by  phone. 

Physicians  told  us  that  they  would  like  to  be  kept  better  informed  of  disease 
incidence  in  the  local  area,  so  you  will  be  provided  with  current  local  information 
in  the  form  of  a  "Physician  Bulletin"  that  will  be  part  of  the  post  card  reporting 
reminder. 

.^       Since  studies  have  shown  that  busy  doctors  often  do  not  report  disease  incidence, 
we  ask  that  you  assign  a  staff  member  (receptionist,  RN,  DA)  to  be  in  charge  of 
reporting.  Because  staff  file  patient  records  and  check  patients  in  and  out,  they 
seem  better  able  to  report  disease  incidence  consistently. 

A  representative  of  the  Health  Department  will  contact  your  office  next  week  to 
finalize  the  procedure  and  to  answer  questions  that  you  and  your  staff  may  have 
about  the  new  procedure.  We  have  enclosed  a  copy  of  this  letter  so  that  you  may 
pass  it  on  to  the  member  of  your  staff  whom  you  would  like  to  be  in  charge  of 
reporting  so  they  may  be  familiar  wit!,  their  role  and  the  new  procedure. 

We  look  forward  to  working  with  you  and  your  staff  to  more  closely  and  accurately 
track  the  incidence  of  communicable  disease  in  Montana.  If  you  have  any  questions, 
please/^all  721^5700,.  extension  379. 


David  A. 


wi  1  f^'^^.iyi&^^W^ 


tant 


end. 
cc:  staff 
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June  9,  1980 


.MAKING  A  DIFFERENCE. 


TO:  Missoula  Physicians  ^^ 


FROM:  The  Missoula  City-County  Health  Department  -^ 

RE:  Reporting  of  Communicable  Disease  ^ 

% 

In  order  to  make  it  easier  for  physicians  to  meet  requirements  for  reporting 
conmunicable  diseases,  the  Health  Department  is  changing  reporting  procedures. 
Your  office  will  be  asked  to  daily  fill  out  a  brief  reporting  sheet  (copy  attached) 
which  was  designed  to  replace  the  currently  used  yellow  cards.  At  the  end  of  the 
reporting  week  (Tuesday  to  Monday),  the  Health  Department  will  call  the  assigned 
staff  member  in  charge  of  reporting  to  ask  for  your  office's  report  over  the  phone. 
For  those  diseases  which  pose  an  immediate  hazard  to  the  community,  we  ask  that 
your  office  call  us  immediately. 

Physicians  have  told  us  that  they  would  like  to  be  kept  better  informed  of  disease 
incidence  in  the  local  area,  so  the  reporting  system  was  designed  to  provide  you 
with  current  local  information  (Physician  Bulletin)  as  part  of  the  post  card 
reporting  reminder. 

"^    Since  studies  have  shown  that  busy  doctors  often  do  not  report  disease  incidence, 
we  ask  that  you  assign  a  staff  member  (receptionist,  RN,  DA)  to  be  in  charge  of 
reporting.  Because  staff  file  patient  records  and  check  patients  in  and  out,  they 
seem  to  be  better  able  to  report  disease  incidence  consistently. 

A  representati ve  of  the  Health  Department  will  contact  your  office  next  week  to 
finalize  the  procedure  and  to  answer  questions  that  you  and  your  staff  may  have 
about  the  new  procedure.  We  have  enclosed  a  copy  of  this  letter  so  that  you  may 
pass  it  on  to  the  member  of  your  staff  whom  you  would  like  to  be  in  charge  of 
reporting  so  they  may  be  familiar  with  their  role  and  the  new  procedure. 

We  look  forward  to  working  with  you  and  your  staff  to  more  closely  and  accurately 
track  the  incidence  of  communicable  disease  in  Montana.  If  you  have  any  questions, 
please  call  721-5700,  extension  379. 


DavidAl  FeSeS<>l6'StTufticer  WillSy  J./Vrma'nT'^fJlftV^Mel^b 


Will\U  J.(\rma" 


insultant 


end. 
cc:  staff 
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June  25,  1980 


TO:  Missoula  Medical  Specialists 
FROM:  The  Missoula  City-County  Health  Department 
RE:  Reporting  of  Communicable  Diseases 


The  Health  Department  is  working  to  improve  the  reporting  of  communicable 
diseases  in  Missoula.  Although  you  probably  see  very  few  reportable  diseases 
in  your  practice,  we  ask  that  either  you  or  a  member  of  your  staff  continue 
to  phone  the  Health  Department  when  you  diagnose  any  of  the  56  diseases 
shov/n  on  the  attached  list. 

A  new  reporting  procedure  has  been  established  for  the  rest  of  the 
medical  community  who  see  communicable  diseases  (internists,  pediatricians, 
GP's,  etc.)  which  involve  their  office  staff  recording  cases  of  reportable 
diseases  daily  on  a  brief  form  and  then  mailing  the  reports  to  us  weekly. 
(Some  selected  physicians  offices  will  receive  a  phone  call  from  the  Health 
Department  to  receive  their  report.) 

We  will  be  carefully  tracking  the  incidence  of  disease  in  the  community 
and  providing  physician  feedback  to  doctors  when  information  of  interest 
becomes  available  —  outbreaks,  unusual  conditions  and  trends.  If  you 
would  like  to  receive  a  copy  of  the  "Physician  Bulletin,"  please  mail  back 
the  enclosed  post  card. 

Thank  you  for  your  continued  help  in  reporting  communicable  diseases.  We 
look  forward  to  strengthening  our  ties  with  Missoula  physicians. 


^\\V-K\, 


WiTiiam  J.  ^^^orman,  Medical  Consultant 


EX.   383 
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.MAKING  A  DIFFERENCE... 


HOW  TO  REPORT  COMMUNICABLE  DISEASES 


Call  "Immediately  Reportable  Diseases"  to  the  Health  Department 
(721-5700,  ext.  383)  within  24  hours  of  diagnosis.  These  diseases 
are  potentially  dangerous  to  the  community  because  of  their  potential 
for  rapid  spread  or  communicability. 


Botulism 

Chancroid 

Cholera 

Diphtheria 

Foodborne  Illness 

Gonorrhea 

Granuloma  Inguinale 


Lymphogranuloma  Venerum 
Measles 

Meningococcal  Disease 
Meningitis,  bacterial 

(other  than  meningococcus) 
Plague 
Poliomyelitis 


Rabies 

Relapsing  Fever, 
louse-borne 
Smallpox 
Syphilis 
Typhoid  Fever 
Typhus,  louse-borne 
Yellow  Fever 


1)^ 


II.  Each  day,  write  patient  name,  disease,  etc.,  on  the  green  "Communicable 
Disease  Reporting  Form"  provided  by  the  Health  Department.  Report 
flu,  chickenpox,  and  diarrheal  illness  by  number  only.  Use  a  tally 
mark  ( r+44.)  for  each  case.  If  you  diagnose  (or  strongly  believe) 
a  patient  has  one  of  these  diseases,  be  sure  to  report  it  under  this 
category. 

Then,  at  the  end  of  the  reporting  week  (which  goes  from  Tuesday  to 
Monday),  you  will  receive  a  post  card  reminder  to  mail  in  your  report 
to  the  Health  Department.  Fold  the  green  form,  staple  it  and  mail 
to  the  address  already  printed  on  the  back  (only  if  something  to  report) 

A  complete  list  of  reportable  diseases  is  attached.  Please  make  the  list  easily 
available  in  your  office.  A  shorter,  "Missoula-specific"  list  is  printed  on  each 
green  reporting  form. 

The  diseases  you  report  to  the  Health  Department  are  investigated  if  they  pose  a 
danger  to  the  public's  health;  they  are  carefully  analyzed  to  see  if  trends  are 
developing,  and  they  are  reported  to  the  State  Health  Department  and  included  in 
total  Montana  information. 


Bill  DeCou 

Communicable  Disease  Coordinator 

12/80 
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...MAKIWG  A  DIFFERENCE. 


HOW  TO  REPORT  COMMUNICABLE  DISEASES 


r 


Call  "Immediately  Reportable  Diseases"  to  the  Health  Department 
(721-5700,  ext.  383)  within  24  hours  of  diagnosis.  These  diseases 
are  potentially  dangerous  to  the  community  because  of  their  potential 
for  rapid  spread  or  communicabil ity. 


Botulism 

Chancroid 

Cholera 

Diphtheria 

Foodborne  Illness 

Gonorrhea 

Granuloma  Inguinale 


Lymphogranuloma  Venerum 
Measles 

Meningococcal  Disease 
Meningitis,  Bacterial 

(other  than  meningococcus) 
Plague 
Poliomyelitis 


Rabies 

Relapsing  Fever, 
louse-borne 
Smallpox 
Syphilis 
Typhoid  Fever 
Typhus,  louse-borne 
Yellow  Fever 


II.  Each  day,  write  patient  name,  address,  etc.,  on  the  green  "Communicable 
Disease  Reporting  Form"  provided  by  the  Health  Department.  Report 
flu,  chickenpox,  and  diarrheal  illness  by  number  only.  Use  a  tally  ( 
mark  (VH-i)   for  each  case.  If  you  diagnose  (or  strongly  believe) 
a  patient  has  one  of  these  diseases,  be  sure  to  report  it  under  this 
category. 

Then,  at  the  end  of  the  reporting  week  (which  goes  from  Tuesday  to 
Monday),  you  will  receive  a  phone  call  from  the  Health  Department 
requesting  your  report. 

A  complete  list  of  reportable  diseases  is  attached.  Please  make  the  list  easily 
available  in  your  office.  A  shorter,  "Missoula-specific"  list  is  printed  on  each 
green  reporting  form. 

The  diseases  you  report  to  the  Health  Department  are  investigated  if  they  pose  a 
danger  to  the  public's  health;  they  are  carefully  analyzed  to  see  if  trends  are 
developing,  and  they  are  reported  to  the  State  Health  Department  and  included  in 
total  Montana  information. 


Bill  DeCou 

Communicable  Disease  Coordinator 
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Date  Received 


MISSOULA  CITY-COUNTY  HEALTH  DEPARTMENT 

Cornmuniaable  Disease  Case  Study 


Diagnosis 


Investigator  #1 

Investigator  #2 

Index  Case 
Name 


Address 


Phone  Number 
Case  History 


By 


Age 


Suspect  □  Confirmed 


Date 
Date 


Sex 


Length  Residence 


Date  Onset 


Treatment 
Employment 


Employer/School 


Length  Employment 


Job  Description 

Phone  Number  

Supervisor  


t** *********************************************************************************** 

MVfUEMIOLOGICAL  NOTES 


Water  Supply 
Milk  Supply 


Date  Well  Last  Tested 
Sewage  System  


Restaurants   Usually  Frequented 


Other  Suspected  Sources  Illness 
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Intimate  Contacts    (Family  and  Others) 
Relationship  Name  Age         Sex  Comments 


Date   Completed 


6/80 
Jsh 


CONTAGIOUS  COMMUNIQUE 


CONTAGIOUS  COMMUNIQUE 


TO:  CD  Clerk  ---  within  1  hourl 


fv 


lOM: 
RE: 


Date: 


disease 
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referral  source  

pt.  name 

address/phone  


sex:   M   F   age  mother/fa 

physician:  

(school grade ) 


TO 

FROM 

RE 


t  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A  A ; 

CD  Clerk  —  within  1  hour! 

Date: 


disease 


referral  source 
pt.  name 


address/phone 


sex:   M  F   age 

physician:  

(school 


mother/fa 


grade ) 


OTHER  INFORMATION: 


OTHER  INFORMATION: 
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CONTAGIOUS  COMMUNIQUE  CONTAGIOUS  COMMUNIQUE 

**************************************************************************************************** 


TO 

FROM 

RE 


CD  Clerk  —  within  1  hourl 


Date; 


disease 


TO:  CD  Clerk  -within  1  hour'. 
FROM:  Date: 

RE: 


disease 


**************************************************************************************************** 


referral  source 
pt,  name  


address/phone 


sex:   M  F  age 

physician:  

(school 


mother/fa 


grade ) 


referral  source 
pt.  name 


address/phone 


sex:   M  F   age 

physician:  

(school 


mother/fa 


grade 


OTHER  INFORMATION; 


OTHER  INFORMATION: 


J 
8/80 


1.21 


j  8/bv 


r 


e 


*) 


«) 


7J 

z 

P 

-a 

0) 

(T) 

1 

o 

3 

1 

T 

1,22 

1 

(* 


t 


2: 

i 

1 
1 

U) 

k 

~-j 

^ 

I 

t 

00 

? 

00 
00 

? 

vO 

? 

r 

f 

f 

? 

0 

0 
0 

0 

:: 

V 

hL 

^ 

M 

t:^ 

1.2: 

Jl 

r^ 


<:* 


$) 


%) 


I 
1 

1 

I 

I 
o 

^ 

? 

T' 

V 

? 

f 

I 

I 

VO 

VD 

f 

T 

s 

! 

? 

? 

? 

r 

o 

|l! 

P 

r 

r 

1. 

'A 

t 

r 


Section  2 

five  communicable  disease  protocols  - 
to  insure  program  accuracy  and  consistency 

Results  -  Before  these  six  protocols  — Measles,  TB,  Hepatitis  A,  Giardiasis, 
Salmonella,  plus  Gonorrhea  (See  Sexually  Transmitted  Disease  Users'  Guide)  — 
were  developed,  the  Missoula  Health  Department  had  only  a  very  general  clinic 
protocol  for  venereal  diseases.   The  six  new  protocols  were  written  and 
carefully  tested.   After  corrections  were  made,  the  protocols  were  finalized 
and  placed  in  central  locations  for  easy  reference.   After  six  months'  use, 
they  were  updated.   The  protocols  are  used  for  reference  and  staff  training. 

Discussion  -  Protocols  are  one  clear  way  of  insuring  program  quality  and 
consistency.   They  are  also  an  excellent  staff  training  tool.   Each  of  the 
six  protocols  were  designed  to  be  applicable  to  any  local  health  department, 
but  may  need  changes  to  fit  your  program's  policies. 

Methodology  -  So  that  you  get  the  most  use  from  them,  protocols  should  be 
thoroughly  tested  before  they  are  finalized.  They  should  then  be  updated 
at  least  yearly  and  kept  current  by  adding  addenda  or  corrections  promptly. 

Protocols 


1.  Measles  (pages  2.2  to  2.10a) 

2.  Tuberculosis  (pages  2.8b  to  2.15) 

3.  Hepatitis  A  (pages  2.16  to  2.21) 
k.  Salmonella  (pages  2.22  to  2.26) 

5.  Giardia  (pages  2.27  to  2.30) 

6.  Gonorrhea  Protocol  — see  Sexually 
Transmitted  Disease  Program  Evaluation. 
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MEASLES 


OTHER  NAMES:  Rubeola,  red  measles,  seven  or  ten-day  measles,  morbilli, 

hard  measles,  Spanish--sarampion. 
RESPONSE: 
I.  Outpatient  Care  Center--give  measles  immunizations  to  children  beginning 
at  age  15  months  (unless  in  an  outbreak  when  eligible  age  for  vaccine 
may  be  reduced  to  6  months;  those  children  do  require  re-vaccination 
at  15  months  to  assure  continued  protection). 

A.  Vaccination  Procedure  (Measles  vaccine  contra-indicated  for  pregnant 
women;  women  should  avoid  pregnancy  for  three  months  after  measles 
immunization. ) 

1.  Explain  procedure  to  parent  and  child,  have  Important  Information 
Form  signed. 

2.  Vaccination--single  dose  of  live  measles  vaccine  in  volume 
specified  by  manufacturer  to  be  given  subcutaneously. 

3.  Fill  out  vaccine  card  and  give  to  parent. 

4.  Keep  vaccination  card  for  health  department  files. 

B.  Re-vaccination--children  vaccinated  before  first  birthday  (particularly 
if  vaccine  was  administered  with  ISG  or  MIG  (measles  immune  globulin) 
should  be  re-vaccinated  with  live  measles  vaccine  after  15  months  of 
age.  Despite  the  risk  of  a  local  reaction,  children  previously 

given  inactivated  (killed)  measles  vaccine  should  be  re-vaccinated 
with  live  vaccine.  Those  vaccinated  prior  to  1968  should  be  re- 
vaccinated  unless  proof  of  live  vaccine  can  be  documented. 
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C.  Immunization  of  susceptible  primary  contacts--Go  to  III.  C.  4.         ^       t 
II.  Surveillance  (Rash  Illness  or  Suspected  Measles  Reports) 

A.  Report  of  rash  illness  will  go  to  nursing  division  Communicable 
Disease  Assistant  to  be  given  to  Communicable  Disease  Coordinator 
within  1/2  hour  and  assigned  for  investigation  within  four  hours. 
1.  Using  Montana  Rash  Illness  Investigation  Form  (from  Communicable 
Disease  Assistant)  call  or  visit  family  and  ask  questions 
(purpose  of  form  is  to  rule  out  measles) . 

a)  If  measles  is  ruled  out,  then  make  a  copy  of  the  front 
page  and  give  to  field  epidemiologist. 

b)  If  measles  cannot  be  ruled  out  ensure  physician  has  diagnosed 
case,  (to  be  able  to  use  quarantine  and  immunization  law  rules), 
then  consult  with  Communicable  Disease  nurse  and  begin 
containment  process.  ^ 

III.  Containment  (if  in  clinical  judgment,  measles  cannot  be  ruled  out). 

A.  Phone  Measles  Case  Report  to  Preventive  Health  Services  Bureau 
(449-4740)  OR  notify  field  epidemiologist  within  four  working  hours 
of  confirmation. 

B.  Begin  investigation  within  four  v^orking  hours  of  confirmation. 

C.  Investigation--locate  additional  cases  to  define  extent  of  outbreak. 
1 .  Search  for  cases. 

a)  Ask  the  first  cases  of  measles  about  his/her  activities 
12-16  days  before  the  onset  of  rash.  This  may  well  turn 
up  the  person  who  was  the  true  first  case.  You  may  be 
able  to  go  back  several  generations  this  way.  Finding 
other  cases  may  help  confirm  the  original  diagnosis. 

b)  Complete  investigation  for  each  case  of  measles. 

c)  Keep  a  line  list  of  all  known  cases  and  suspects  in  one 
central  spot  (Outpatient  Care  Center). 
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d)  Once  you  know  how  big  the  outbreak  is,  assess  your 
resources.  If  there  are  only  a  few  cases,  it  should  be 
feasible  to  follow  the  rest  of  this  protocol.  You  may 
decide  to  ask  for  help  to  get  the  job  done  or  for  advice 
on  how  to  proceed.  Or  you  may  decide  to  mount  a  larger 
scale  immunization  campaign  if  there  are  too  many  cases 
to  investigate  individually. 

e)  A  Measles  Quarantine  Rule  was  adopted  on  June  15,  1979 
and  should  be  considered  at  this  time.  See  Administrative 
Rules  of  Montana  16.28.618.  (See  Appendix) 

Identify  susceptible  contacts.; 

a)  For  each  knov/n  case,  find  out  who  was  exposed  beginning 
four  days  before  the  rash  appeared  and  going  up  to  four 
days  after  the  rash  appeared.  Include  children  in  the 
doctor's  waiting  room  if  the  case  saw  a  doctor.  These 
are  the  primary  contacts.  List  them  on  the  back  of  the 

■  case  investigation  form  (see  page  2.9a) .  They  are  at 
highest  risk  of  getting  measles,  and  by  the  time  of 
investigation  may  already  be  incubating  measles. 

b)  For  each  primary  contact,  find  out  if  he/she  already  has 
measles,  is  known  to  be  immune,  or  is  susceptible.  Add 
those  with  measles  to  the  case  list.  Have  parents  of 
primary  contacts  call  if  measles  develops. 

c)  Call  parents  of  susceptible  primary  contacts  after  their 
incubation  period  to  detect  secondary  cases. 

d)  For  susceptible  primary  contacts,  find  out  who  their 
contacts  are.  These  are  secondary  contacts  and  are  at 
risk  for  measles  because  the  primary  contacts  may  already 
be  infectious  at  the  time  of  investigation. 


3.  Keep  active  cases  home  to  limit  spread,  for  no  less  than  five 
days  after  onset  of  rash.  People  who  are  not  immune  to  measles 
should  be  kept  from  contact  with  the  active  case.  Susceptible 
contacts  may  be  quarantined.  See  ARM  16. 28. 618(3)b.— Appendix. 

4.  Immunize  the  susceptibles. 

a)  All  susceptible  primary  contacts  should  be  immunized  with 
live  vaccine  except: 

1)  Those  aged  less  than  six  months,  who  should  have  anti- 
body from  their  mothers  and  need  no  immunization. 

2)  Those  with  medical  contra-indi cations  to  measles 
vaccine,  who  should  get  gamma  globulin  (0.11  ml/lb). 

3)  Susceptible  household  contacts  aged  6  to  15  months  are 
too  old  to  have  antibody  from  their  mothers,  but  too 
young  to  be  effectively  immunized  with  live  vaccine. 
They  should  get  gamma  globulin  (0.11  ml/lb). 

b)  Children  below  age  15  months  who  get  either  gamma  globulin 
or  live  vaccine  should  be  carefully  followed  to  make  sure 
that  they  are  immunized  again  with  live  vaccine  at  age  15 
months  (and  at  least  three  months  after  the  last  gamma 
globulin  injection). 

c)  It  may  be  necessary  to  involve  groups  of  community  volunteers 
to  make  sure  signed  consent  forms  or  documentation  of 
immunity  are  obtained  for  all  primary  contacts.  It  is 
rarely  enough  to  just  send  consent  forms  home  with  children, 
too  many  who  need  immunizations  do  not  bring  them  back  and 
too  much  vaccine  is  given  to  those  who  do  not  need  it. 

d)  Immunize  susceptible  secondary  contacts.  Here  priorities 
have  to  be  set:  how  likely  is  the  primary  contact  to  get 
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measles?  (Vaccine  may  be  protective  to  the  primary  contact 
if  given  within  48  hours  of  his/her  initial  exposure.) 
What  will  happen  if  the  secondary  contact  gets  measles- 
does  he/she  go  to  a  school  where  there  is  no  measles? 
Will  he/she  be  going  to  a  big  gathering?  and  so  on. 

e)  Consider  going  into  homes  to  immunize  contacts,  especially 
pre-school  children. 
5.  Keep  up  surveillance.  Do  not  consider  the  outbreak  over  until 

at  least  three  weeks  have  gone  by  with  no  new  cases.  Keep 

looking  for  cases  and  unlocated  contacts. 

DESCRIPTION: 
Agent  is  measles  virus,  an  RNA  virus. 

Disease  is  acute  and  highly  communicable.  Symptoms  are  three  to  four  days 
of  fever  (100°-104°),  cough,  coryza  and  conjunctivitis;  symptoms  peak  as 
rash  appears.  Koplik  spots  are  seen  in  80%  of  cases  in  the  pre-eruptive 
stage  on  the  buccal  mucosa  (check  inner  lips  or  opposite  the  lower  molars). 
Koplik  spots  are  small  bright  red  irregular  lesions.  In  daylight  there 
is  a  minute  bluish-white  speck  in  the  center.  As  the  disease  progresses 
the  spots  spread  and  become  more  prominent  but  fade  within  two  days  of 
onset  of  rash.  Stimson's  sign:  shortly  after  onset  of  fever  the  lower 
eyelids  become  puffy  and  a  transverse  line  of  inflammation  develops  on  the 
conjunctiva  of  these  lids.  Photophobia  may  be  present.  The  rash  is  dusky 
and  reddish-brown  appearing  three  to  seven  days  after  onset  of  prodrome. 
Starting  at  the  hairline  or  on  the  face  and  progressing  downward,  it  is 
generalized  by  the  third  day.  Rash  fades  from  four  to  six  days  after  onset, 
ending  in  branny  desquamation.  Fever  is  present  at  least  two  days  after 
onset  of  rash. 
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Atypical  measles  occurs  upon  measles  exposure  in  some  persons  who  received     ^ 
•the  killed  measles  vaccine  or  the  killed-live  measles  vaccine  combinations 
in  1963-67.  Atypical  measles  usually  begins  with  2-3  days  of  fever,  headache 
and  cough  followed  by  a  maculopapular  rash  which  starts  on  the  wrists  and 
ankles  and  spreads  centrally  as  well  as  to  the  palms  and  soles  and  which 
may  become  vesicular  or  petechial,  peripheral  edema,  abdominal  pain,  chest 
x-ray  evidence  of  pneumonitis,  hilar  adenopathy,  or  pleural  effusion,  and 
a  marked  measles  antibody  titer  rise. 

The  most  common  complications  are  bronchopneumonia,  severe  bronchitis, 
myocarditis,  and  otitis  media.  Rare  complications  can  include  encephalitis, 
thrombocytopenia,  exacerbation  of  tuberculosis  infection,  and  subacute         ^ 
sclerosing  panencephalitis  (SSPE)  and  death. 

RESERVOIR: 
Transmission  by  droplet  spread  of  direct  contact  with  secretions  of  nose,     M) 
throat  or  urine  of  infected  person;  less  commonly  airborne  or  articles 
freshly  contaminated  by  secretions  of  nose  and  throat. 

INCUBATION  AND  COMMUNICABILITY : 
The  average  incubation  period  is  ten  days  and  can  vary  from  8  to  13  days 
from  exposure  to  initial  fever.  Typically,  the  rash  appears  two  weeks  after 
exposure.  In  adults,  incubation  is  often  longer.  Late  inoculation  with 
measles  immune  serum  globulin  (gamma  globulin)  may  extend  incubation  period 
to  21  days. 

Communicable  from  beginning  of  prodromal  period  to  four  days  after  appearance 
of  rash. 

DIAGNOSIS: 

Made  principally  from  symptomatology  and  acute  and  convalescent  (two  weeks    , 

after  acute)  antibody  titers.  Virus  may  be  isolated  from  blood,  conjunctiva 

and  nasopharynx.  Leukopenia  is  prominent  after  onset  of  rash.  Koplik  spots 

are  pathognomonic. 
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DIFFERENTIAL  DIAGNOSIS: 

Rubella,  Scarlet  fever,  Roseola,  secondary  syphilis,  exanthem  due  to 

coxsackie  or  Echo  viruses.  Rocky  Mountain  spotted  fever. 
CONTROL: 

Prevention  is  by  vaccination  with  live  attenuated  measles  strains  and  by 

prompt  investigation  and  surveillance. 


MONTANA 
RASH  ILLNESS  INVESTIGATION  FORM 


PATIENT'S  NAME 

PARENT'S  (Gudrdian's) 

BIRTH  DATE  

ADDRESS 

COUNTY 

STATE 


.  SEX  

PARENT 

S 

RACE 
PHONE 

CITY 

ZIP  CODE 

RASH  ONSET  DATE 
HOSPITAL 


HOSPITALIZED?  YES  □  HO  Q 
ADDRESS  


REPORTED  BY 


DATE  OF  REPORT 


ADDRESS  OF  REPORTING  SOURCE 
DISEASE  SUSPECTED  


Health  Dept.  

Date  Investi- 
gation Initiated 


VACCINE  DATA 

1)  Measles  (Rubeola)   Yes  □  No  Q 
Age  when  immunized 


Type  of  Vaccine:  Live  Q  KH  led  Q  Unk  □ 
2)  Rubella:  YES  Q  NO  Q 

Age  when  Imnunlzed  


Fami ly  Physician 

Address 

Phone   


FEVER  HISTORY 
1)  Fever  Onset 


Month      Day        Year 

2)  Fever  (Highest  Recorded) Date  _ 

3)  Fever  Duration  Days 

k)    Fever  at  Rash  Onset  


RASH  HISTORY 
1)  Rash  Onset 


Month        Day 

2)  Rash  Duration  Days 

3)  1st  location  of  rash  

>i)    Spread  of  Rash 


5)  Drugs  before  Rash  (Specify)  YES  [71  NO  □ 


RASH  DESCRIPTION 


Reddish 

Dusky  Brown 

Harked  Itching 

Distinct  6  Even 
Distributed 


Q Some  discrete  lesions  & 
some  areas  blotchy  & 
confluent 

□  watery  Vesicles 

□  OTHER  (Specify 


l)Koplik  Spots 
Date  seen: 


By  Whom:  

2)Strawberry  Tongue 

3)Cough 

»l)  Runny  Nose 

5)Fever  after  rash 
onset 

6)Watery  or  red 

7) Nausea 

8)Vomiting 

9)Patient  very  sick? 
10)Malaise 
11 ) Photophobia 


YES   NO   UNK  YES   NO   UNI^ 

n  n  n  1Z)Loss  of  appetite 

13) Sore   throat 

1'4)Swol  len    lymph  gli 

"  ""  ^'^'^ CTTTn 


eyes 


15)Circumoral  pallor 

(Paleness  around 
mouth) 
16) Desquamation       □ 

(Skin  shedding) 

Describe 


DD 


PATIENT  EXAMINED  BY : 
PRIVATE  DOCTOR 
PUBLIC  HEALTH  DOCTOR 
PHN  or  RN 
SCHOOL  HURSE 
IMMUNIZATION  PROGRAM 
STAFF 
OTHER  (Specify) 


□  D'^TE_ 

□  fATE_ 

□  DATE_ 

□  DATE_ 

□  DATE_ 
Q  OATE_ 


LABORATORY  DATA 

Acute  Blood:  Date  

Convalescent  Blood:  Date 
Throat  Culture:  Date 


Result 
Result 


PAT  I ENT  CONTACT  DATA 

1)  Where  was  patient  ^^   days  pri 


onset  of  rash? 


2)  Where  has  patient  been  between  1  week  prior  to  onset  of  r.ish  and  5  days  after  rash  onset? 


Group  Meetings    Date 

Babysitter 

Fami ly  Gathering 


School /Daycare  (Specify) 
Other   (Specify) 


□  Date 
P  Date 


NOTE:     Mafee  a  copy  o^  thu  ^Idz  AjmzdU.atzly  and  iofumAd  to  P^e.v^ntivz  H^aJUk  S2Avlct6 
Bureau,  SVHES,   Hzl^na,   MT     59601.     ALSO,   Call  n.Q.pofcti>  oi  ^u^pactzd  mzaAl(^ 
<jmtdlatzly  to    1-800-332-2288    (Toll-free),   or   k^S-lGkS    (Helena). 
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A)   PRIMARY  CONTACTS:   Those  Persons  exposed  to  the  Patient  (e.g.,  school,  ddy  care,  friends,  in  Dr.'s  offi 


NAME  £  ADDRESS 

PHONE 

AGE 

VACCINE  TYPE 
AND  DATE 

FOLLOW-UP 
CALL  DATE 

IF  HAD  ILLNESS 
ONSET  DATE 

R^   SFf.ONDARY  CONTACTS:   Those  persons  exposed  to  SUSCEPTIBLE  (Unvacc 

nated)  PRIMARY  CONTACTS 

NAME  e  ADDRESS 

PHONE 

AGE 

VACCINE  TYPE 
AND  DATE 

FOLLOW-UP 
CALL  DATE 

IF  HAD  ILLNESS 
ONSET  DATE 

WAS  MEASLES  VACCINE  (OR  GG  WHERE  NECESSARY)  RECOMMENDED  TO  EACH  SUSCEPTIBLE  CONTACT?   YES  Q   NO  □ 

C)  DOES  THE  PATIENT  (OR  PARENT)  HAVE  KNOWLEDGE  OF  OTHERS  WITH  A  SIMILAR  ILLNESS?   YES  [_J  NO  |_|  If  yes,  complete  the  followi 


NAME  t  ADDRESS 


VACCINE  TYPE 
AND  DATE 


FOLLOW-UP 
CALL  DATE 


IF  HAD  ILLNESS 
ONSET  DATE 


NOTE:     I(i  addW-onal  6pac^  li  nzzdzd  jon.  compleXlng  poAti  A.   B.  01  C.  aiXach  e.KiAa  ihzeXji). 


TO  BE   COMPLETED  BY  HEALTH  OFFICER  OR  IMMUNIZATION  PROGRAM  STAFF  MEMBER 


Enrollment  of  child's  school /daycare/Head  Start  

Number  of  susceptibles  in  group  

Source  of  Immunization  Information: 

B   Special  Record  Audit  by  Health  Dept.  Personnel 
Special  Audit  by  school /daycare/  Head  Start  Personnel 
What  Immunization  measures  were  taken  to  protect  susceptibles 


FINAL  DIAGNOSIS: 

□  MEASLES    □  GROUP  A  STREP 

P  RUBELLA    □  OTHER  (Specify) 


PRESCHOOL  MEASLES  IMMUNIZATION  STATUS 
SOURCE  OF  IMMUNIZATION  DATA: 


IN  THIS  PATIENT'S  COUNTY 


2  Year 
School 


B 


Day  Care 
Preschoo 


YOU  CALL  SURROUNDING  SCHOOLS/DAYCARES/HEAD  STARTS  TO  ALERT  THEM 
WHY 


n 

n 


Other     □ 

(Specify)  

Unknown 


TO  FIND  OTHER  CASES?   YES  □   NCQ 

D    NO  D 


DID  YOU  NOTIFY  LOCAL  PHYSICIANS  TO  ALERT  THEM  AND  TO  REQUEST  PROMPT  REPORTS  OF  ADDITIONAL  CASES? 

DID  YOU  REQUEST  PUBLICITY  FROM  THE  MEDIA?   YES  Q   NO  □  r"!   ,^  n 

IF  YOU  SUSPECT  RUBELLA:   IS  THE  PATIENT  PREGNANT?YES  Q  NO  Q  ;  ANY  CLOSE  CONTACTS  PREGNAHT?  YES  LJ  NO  LJ 

IF  SO,  DESCRIBE  TREATMENT/AND/OR  ADVICE  GIVEN  TO  PREGNANT  WOMEN: 

WERE  CHILDREN  PRESENT  IN  DOCTOR'S/NURSE'S  OFFICE  AT  TIME  OF  VISIT?    YES  □   NO  □ 


PHSB/lMM/879-1 


MONTANA 
RASH  ILLNESS  INVESTIGATION  FORM 


PATIENT'S  NAME_ 

PARENT'S  (Gudrdian's)  NAME  (If  not  Adult)  

BIRTH  DATE SEX  RACE_ 

ADDRESS 

COUNTY 

STATE      


PARENT'S  PHONE 


CITY 


ZIP  CODE 


RASH  ONSET  DATE 

HOSPITAL  

CITY 


_  HOSPITALIZED?  YES  □  NO  f] 
ADDRESS     


REPORTED  BY 


DATE  OF  REPORT 


ADDRESS  OF  REPORTING  SOURCE 
DISEASE  SUSPECTED 


Name  of 

Investigator 

Health  Dept. 

Date  Investi- 
gation Initia 

ted  _ 

_ 

_ 

_ 

VACCINE  DATA 

1)  Measles  (P 

ubeo 

a) 

Yes 

D 

No 

D 

Age  when 

mmun 

zed 

2)  Rubella:  YES  Q  "0  Q 
Age  when  immunized  


Fami 1 y  Phys  ician 

Address 

Phone 


FEVER  HISTORY 
1)  Fever  Onset 


Month      Day         Year 

2)  Fever  (Highest  Recorded) Date  

3)  Fever  Duration  Days 

i))  Fever  at  Rash  Onset  


RASH  HISTORY 


Month        Day       Year 

2)  Rash  Duration  Days 

3)  1st  location  of  rash  

I))  Spread  of  Rash 


5)  Drugs  before  Rash  (Specify)  YES  [~|  NO  Q 


RASH  DESCRIPTION 

I  I   Reddish  Q  Some  discrete  lesions  & 

□„   ,   -  some  areas  blotchy  6 

Dusky  Brown  confluent 

□  ^^'^^'^    '"^^'"9  QWatery  Vesicles 

Distinct  &  Evenly 

Q   Distributed  [J  OTHER  (Specify 


l)Kopl  ik  Spots 
Date  seen: 


By  Whom: 


2)Strawberry  Tongue 

3)Cough 

Jt)  Runny  Nose 

5)Fever  after  rash 

onset 
6)Watery  or  red  eyes 
7) Nausea 
8)Vomiting 

9)Patient  very  sick? 
IO)Malaise 
1 1 ) Photophobia 


YES   NO   UNK  YES 

n  □  n  '2)Loss  of  appetite    \ 
13)Sore  throat 
1'))Swollen  lymph  gland] 

if  yes,  where ^_^ 

15)Circumoral  pal  lor   |  | 
(Paleness  around 
mouth) 
l6)Desquamation       LJ 
(Skin  shedding) 
Describe  _^ 


urn 


PATIENT  EXAMINED  BY: 
PRIVATE  DOCTOR 
PUBLIC  HEALTH  DOCTOR 
PHN  or  RN 
SCHOOL  NURSE 
IMMUNIZATION  PROGRAM 
STAFF 

OTHER  (Specify) 


□  DATE_ 

□  ['ATE_ 

□  DATE_ 
Q  DATE_ 

Q  OATE_ 

Q  DATE_ 


LABORATORY  DATA 


Acute  Blood:  Date 

Res 

Convalescent  Blood:  Date 

Res 

Throat  Culture:  Date 

_  Result, 

PATIENT  CONTACT  DATA 

1)  Where  was  patient  l**  days  prior  to  onset  of  rash?_ 


:re  has  patient  been  bet* 


Church 

■ 

Date 

Group  Meetings 

Date 

Babysitter 

Date 

Fami ly  Gathering 

_ 

Date 

onset  of  rnsh  and  5  days  after  rash  onset? 

School /Daycare  (Specify)  Q  Date 

Other   (Specify)  Q  Date 


Makz  a  copij  oi  thjj,  ilde.  -umzdiateZy  a^^d  ioniMVid  to  Puzvmtivz  HzaZXh  SoAvic^^ 
Bu/ie.au,  SVHES,  Helena,  MT     59601.     ALSO,   CaU.  fizpofuii>  oi  6uu>pe.cte.d  mzcalza 
ismzdlcutdty  to    1-800-332-2288    (Toll-free),   or  i»it9-26it5    (Helena). 


2.9a 


A)   PRIMARY  CONTACTS:   Those  Persons  exposed  to  the  Patient  (e.g.,  school,  day   care,  friends,  in  Dr.'s  office,  etc.) 


NAME  6  ADDRESS 

PHONE 

AGE 

VACCINE  TYPE 
AND  DATE 

FOLLOW-UP 
CALL  DATE 

IF  HAD  ILLNESS 
ONSET  DATE 

r 


B)   SECONDARY  CONTACTS:   Those  persons  exposed  to  SUSCEPTIBLE  (Unvacc 

nated)  PRIMARY  CONTACTS 

NAME  6  ADDRESS 

PHONE 

AGE 

VACCINE  TYPE 
AND  DATE 

FOLLOW-UP 
CALL  DATE 

IF  HAD  ILLNESS 
ONSET  DATE 

WAS  MEASLES  VACCINE  (OR  GG  WHERE  NECESSARY)  RECOMMENDED  TO  EACH  SUSCEPTIBLE  CONTACT?   YES  P   NO  □ 

C)  DOES  THE  PATIENT  (OR  PARENT)  HAVE  KNOWLEDGE  OF  OTHERS  WITH  A  SIMILAR  ILLNESS?   YES  [J  NO  [J  If  yes,  complete  the  following 


NAME  6  ADDRESS 

PHONE 

AGE 

VACCINE  TYPE 
AND  DATE 

FOLLOW-UP 
CALL  DATE 

IF  HAD  ILLNESS 
ONSET  DATE 

■ 

NOTE:  If,  addltioniU  Apace  li  mzdzd  doi  compliZing  p<vuti 


A.  B.  01   C,  cuttach  txtAa   Ahee^U). 


TO  BE   COMPLETED  BY  HEALTH  OFFICER  OR  IMMUNIZATION  PROGRAM  STAFF  MEMBER 


Enrollment  of  child's  school /daycare/Head  Star 
Number  of  susceptibles  in  group 
Source  of  Imr 


ion  Information: 

B   Special  Record  Audit  by  Health  Dept.  Personnel 
Special  Audit  by  school /daycare/  Head  Start  Personnel 
What  Immunization  measures  were  taken  to  protect  susceptibles 


FINAL  DIAGNOSIS: 

□  MEASLES    □  GROUP  A  STREP 

Q  RUBELLA    □  OTHER  (Specify) 


PRESCHOOL  MEASLES  IMMUNIZATION  STATUS 
SOURCE  OF  IMMUNIZATION  DATA: 


THIS  PATIENT'S  COUNTY 


2  Year  Survey 
School  Enterer 


B 


Day  Care  Q 
Preschool 

ItiativeQ 


Other     □ 

(Specify)  

Unknown 


310  YOU  CALL  SURROUNDING  SCHOOLS/DAYCARES/HEAD  STARTS  TO  ALERT  THEM  t  TO  FIND  OTHER  CASES?   YES  □   NOQ 

If  "No"  WHY ____^____ r-i      1—1 

310  YOU  NOTIFY  LOCAL  PHYSICIANS  TO  ALERT  THEM  AND  TO  REQUEST  PROMPT  REPORTS  OF  ADDITIONAL  CASES?   YES  |_J   NO  [_] 

3ID  YOU  REQUEST  PUBLICITY  FROM  THE  MEDIA?   YES  □   NO  □  r-i     i—i 

IF  YOU  SUSPECT  RUBELLA:   IS  THE  PATIENT  PREGMANT7YES  Q  NO  □  ;  ANY  CLOSE  CONTACTS  PREGNANT?  YES  [J  NO  LJ 

IF  SO,  DESCRIBE  TREATMENT/AND/OR  ADVICE  GIVEN  TO  PREGNANT  WOMEN: 


WERE  CHILDREN  PRESENT  IN  DOCTOR'S/NURSE'S  OFFICE  AT  TIME  OF  VISIT?     YES   Q   NO  Q 


PHSB/lMM/879-1 


APPENDIX 


16.28.618  MEASLES— RUBEOLA  (1)  The  provisions  of  this  rule  apply  to 
measles,  exiusive  of  quarantine  measures  contained  in  other  rules  for  control 
of  communicable  disease. 

(2)  Unless  otherwise  specified,  for  the  purposes  of  this  rule  the 
following  definitions  apply: 

(a)  "Immunity"  means  immunity  to  measles,  as  demonstrated  by: 
(i)  a  school  health  record  showing  approved  measles  vaccine  was 

administered: 

(A)  either  in  1968  or  later,  or  between  1966  and  1968  if  the  vaccine 
was  a  documented  live  vaccine;  and 

(B)  after  the  first  birthday,  documented  by  the  month,  day  and  year 
of  administration  of  the  vaccine,  except  that  only  the  month  and  year   are 
necessary  if  the  person  was  enrolled  in  any  Montana  school  prior  to  August  1, 
1980,  or  is  a  transferee  into  a  Montana  school  from  out-of-state. 

(ii)  a  signed  statement  from  a  physician  or  his  designee  that  the 
person  has  had  measles  disease,  indicating  the  month,  day  and  year  of 
diagnosis,  except  that  only  the  month  and  year  are  necessary  if  the  person 
v/as  enrolled  in  any  Montana  school  prior  to  August  1,  1980  ,  or  is  a  trans- 
feree into  a  Montana  school  from  out-of-state. 

(b)  "Measles  case"  means  a  person  suffering  from  measles,  from  5  days 
before  the  onset  of  rash  to  5  days  after  the  onset  of  rash. 

(c)  "Susceptible  contact"  means  any  person  not  able  to  demonstrate 
immunity  who  is  less  than  21  years  of  age  and  who  has  been  exposed  face- 
to-face  to  a  measles  case,  or  attends  the  same  school  as  a  case  or  rides 
the  same  school  bus  as  a  case. 

(3)  A  local  health  officer  or  the  department  may  impose  isolation  or 
quarantine  based  on  the  diagnosis  of  measles  in  one  or  more  persons  as 
confirmed  by  a  physician.  If  isolation  or  quarantine  is  imposed,  the  local 
health  officer  shall  post  public  notice  of  the  effective  date  of  the  isola- 
tion or  quarantine  and  make  immunizations  available,  free  of  charge  to 
extent  of  his  resources,  upon  request. 

(a)  A  measles  case  must  be  isolated  to  his  residence  for  no  less  than 

5  days  following  the  onset  of  rash.  The  movements  of  other  household  contacts 
in  or  out  of  the  residence  are  not  restricted  unless  they  are  susceptible 
contacts.  The  local  health  officer  shall  advise  the  household  contacts 
where  the  measles  case  is  isolated  to  warn  a  person  who  is  not  immune  against 
measles  against  entering  the  residence. 

(b)  A  susceptible  contact  must  be  quarantined  in  his  residence  for  no 
less  than  14  calendar  days  after  his  last  exposure  to  measles,  whether  face 
to  face  with  a  measles  case  or  by  attendance  at  school  or  school -sponsored 
activities.  The  movements  of  any  other  person  in  or  out  of  the  residence 
is  not  restricted. 

(c)  A  susceptible  contact  may  be  released  from  quarantine  to  receive 
immunization  against  measles,  and  may  return  to  school  and  school -sponsored 
activities  after  having  received  measles  immunization  from  a  physician  or 
local  health  officer  and  having  submitted  written  documentation  of  such 
immunization  to  the  school  in  accordance  with  the  provisions  of  sub-chapter 
7  of  this  chapter. 

(4)  If  a  school  with  a  measles  case  allows  a  susceptible  contact  who 
receives  immunization  to  attend  classes,  no  student  of  that  school  may 
participate  in  an  interscholastic  event  for  14  calendar  days  following  the 
date  of  immunization  of  the  susceptible-contact  student.  (History:  Sec. 
50-1-202,  50-2-118  MCA;  IMP,  Sec.  50-1-202,  50-2-118  MCA;  NEW,  1980  MAR 

p.  1579,  Eff.  6/13/80.)  ^    ,q^ 


TUBERCULOSIS 

OTHER  NAMES:  Consumption,  white  plague,  TB. 

CASE  DEFINITION:  ...  ^^ 

A  tuberculosis  case  is  defined  as  either  a  physician  diagnosis  or  a  posxtxve 
laboratory  isolate  of  mycobacterium  tuberculosis. 

RESPONSE:  ^  ^^     ,  ^^ 

I   Cases  reported  to  the  Health  Department  -  find  all  household  or  close 
contacts  (i.e.,  families,  students  if  teacher,  bartender,  etc.,  or 
anyone  who  shared  the  environmental  air  with  a  source  case  for  a 
relatively  longer  time  than  other  known  contacts).  If  out-of-area, 
notify  the  State  Health  Department  to  locate. 

A.  Give  each  intimate  contact  a  Mantoux  (PPD)  skin  test  (see  III,B) 
within  ^8  hours  of  location. 

B.  Arrange  to  read  test  within  H8-72  hours  (go  to  home  to  give  or 
read  PPD  test  if  necessary). 

1.  If  negative,  repeat  test  in  three  months  to  insure  a  second 
negative  result. 

2  If  positive,  send  to  private  doctor  for  chest  x-ray  within 
one  week.  (The  Health  Department  is  able  to  help  patients 
pay  for  x-rays  if  they  are  unable.)  Follow-up  within  one 

week. 

a.  If  x-ray  is  negative,  there  is  no  need  to  repeat. 

b   If  x-ray  is  positive,  the  patient  must  be  examined  by  a 

physician  with  sputum  culture  follow-up  to  rule  out  possible 
active  TB  before  determining  whether  chemoprophylaxis  is 
appropriate.  Some  physicians  treat  on  positive  x-ray. 

II.  Surveillance 

A   Identification  of  Infected  Persons  -  TB-infected  persons  are  most 
likely  to  be  found  in  the  following  situations  where  risk  of  disease 

is  greatest. 

1   Household  contacts,  both  tuberculin  negative  and  tuberculin 

positive  (especially  children),  r/z.  ri.k  during  tke  first  year 
after  discovering  the  index  case  is  about   1   in  30. 

2.  Recent  converters  of  any  age. 
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3.  Old  inactive  cases  which  were  not  treated  with  chemotherapy. 
k.     Positive  reactors  with  abnormal  pulmonary  findings  on  chest 
x-ray. 

5.  Positive  reactors  under  the  age  of  20  years. 

6.  Special  clinical  situations,  e.g.,  gastrectomy  patients,  patients 
on  immunosuppressive  therapy,  alcoholics. 

B.  Determination  of  Infection  -  The  nebulized  sputum  or  chest  x-ray 
is  the  best  diagnostic  test  for  determining  infection  of  at-risk 
persons. 

C.  Following  Active  Cases 

1 .  Getting  active  cases  under  treatment  usually  involves  hospi- 
talization to  administer  3-drug  therapy  and  observation  of 
patients' response  to  anti-TB  drugs.  Patient  then  may  be  released 
to  continue  drug  therapy  (in  difficult  cases,  it  may  be  necessary 
to  follow-up  several  times  per  month  with  visits  to  the  patient). 
Drugs  are  usually  given  two  or  three  at  a  time  to  prevent  tubercle 
from  becoming  drug- resistant.   The  most  commonly  used  drugs 
include  myambutol  (ethambutol)  rifampin,  streptomycin,  and 
isoniazid  (INII).  Patient  must  be  carefully  monitored  for  symptoms 
of  drug  reaction  and  liver  function  problems. 

2.  Upon  completion  of  medication, 'a  chest  x-ray  or  nebulized  sputum 
is  a  proof-of-cure, 

3.  Test  all  contacts  using  Mantoux  test.  Positive  reactors  to  the 
above  test  who  are  at  high  risk  (alcoholics,  diabetics,  teen- 
agers and  young  children)  are  usually  put  on  INH  chemoprophlaxis 
for  one  year.   (INH  inhibits  growth  of  the  encapsulated  tubercle 
and  thus  prevents  the  patient  from  getting  active  TB.)  The  success 
of  the  INH  largely  depends  on  the  patients'  understanding  and 
compliance  and  subsequently  on  the  public  health  worker  who 
explains  the  therapy  and  follows  the  patient. 

k.     The  Health  Department  can  help  with  x-ray,  INH,  and  nebulized 

sputum  collection  expenses  if  necessary. 
5.  Converters  (person  who  goes  from  negative  to  positive)  are  at 
high  risk  of  "breaking  down,"  or  becoming  active.  Make  sure  the 
patient  receives  a  chest  x-ray  or  physical  at  least  once  per  year. 
Outpatient  Clinic 
TB  testing  is  necessary  for  teachers,  day  care  workers,  foster  care 
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personnel,  nursing  home  personnel,  health  department  nursing  personnel  and 
knoira  or  suspected  contacts  of  an  active  TB  case. 

A.  Monovac  (tine)  test  is  used  for  routine  testing  (teachers,  etc.). 
Equipment  needed:  TB  card,  alcohol  swab,  monovac  (or  tine)  test. 

1.  Ask  patient  if  he/she  has  ever  reacted  positively  to  a  TB  test. 

a.  If  no,  conduct  test. 

b.  If  yes,  refer  patient  for  chest  x-ray. 

2.  Ask  patient  if  he/she  is  a  TB  suspect  or  contact  and  if  yes,  administer 
PPD  (or  Mantoux)  test,  NOT  Monovac. 

3.  Fill  out  TB  card.   (Negative  TB  cards  are  filed  for  at  least  two 
years;  positive  reactors  and  converters'  cards  are  kept  on  file 
permanently. ) 

k.     Swab  (1)  volar  forearm  with  alcohol.  Let  area  dry. 

5.  Apply  test  for  at  least  5  seconds  (count  1-1,000,  2-1,000,  3-1,000) 
follow  procedure  on  test  leaflet. 

6.  Schedule  patient  to  return  in  3  or  ^  days  to  read  test;  record  results. 

7.  If  test  is  positive,  repeat  on  (r)  volar  forearm  with  PPD  test  (III,B). 

B.  Mantoux  (PPD  test) is  used  for  known,  or  suspected  (household)  TB  contacts. 
Equipment  needed:  TB  card,  tuberculin  syringe  with  5/8"  25  gm  needle, 

1  cc  of  tuberculin,  alcohol  swab. 

1 .  If  patient  is  a  known  positive  reactor,  refer  for  chest  x-ray. 

2.  Draw  .1  cc  tuberculin  into  TB  syringe. 

3.  Swab  (1)  volar  forearm  with  alcohol.  Let  area  dry. 

k.      Insert  .Ice  tuberculin  interdermally  to  form  a  wheal.   (If  wheal  is 

not  formed,  repeat  test  at  another  site.) 
5.  Schedule  patient  to  return  in  2  or  3  days  so  that  test  may  be  read 

and  recorded. 

a.  If  test  is  positive,  refer  patient  for  chest  x-ray  immediately. 
Follow-up.  Financial  help  is  available  from  the  Health  Department 
for  patients  who  cannot  afford  to  pay  for  x-ray. 

b.  If  test  is  negative,  advise  patient  to  have  another  test  in 
three  months  to  allow  for  potential  conversion  factor.   (TB  is 

a  slow-growing  organism  and  conversion  from  negative  to  positive 
reactor  is  a  slow  process.) 
NOTE:   Chemoprophylaxis  -  use  of  isoniazid  or  INH  for  12  months  to  prevent 
development  of  active  TB  in  high  risk  situations.  Dosage  -  Adults 
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TUBERCULOSIS  SKIN  TESTING  SURVEY 


DATE  TEST 
DONE 


SPECIFY  TYPE: 

Tine  (T),  PPO   (P), 

Other  (Specify) 


REASON   FOR   TESTING: 

Routine    (A),  Teacher   (B),   Daycare   Emp.    (C), 

Health   Care   Emp.   (Dl,  Other   (Specify) 


SEX 


K 


POSITIVE   REACTORS 


Retested 
with  PPD 


Normal      Abnormal 


Chemotherapy? 


Reported  By: 


Phone   Number: 


PHSB-TB^     a/81 
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m 


TUBERCULOSIS  INFORMATION  EXCHANGE 


\r 


TO: 


FROM: 


PATIENT:. 
ADDRESS: 


TYPE:  Q  Pulmonary           |      | Other 
DATE  DIAGNOSED: 


(Specify) 


DATE  OF  BIRTH: 

SEX RACE 


AGE: 


DIAGNOSING  PHYSICIAN: 
CONTACT  OF:  


KNOWN  CASE   (name): 


DATE  OF    LAST   LAB  TEST: 


LAB  WHERE  TEST  WAS  DONE: 
I     I  Sputum  I     [other  


Smear: 

LJ  Positive 
V^        □Negative 

I    [Results  Unknown 


Culture: 

n  Positive 
I  [Negative 
rj  Results  Unknown 


DATE  OF    LAST  X  RAY: 

I I  Normal 

I    I  Improving 


I    I  Abnormal 
[~|  Worsening 


CHEMOTHERAPY  STARTED 


Isoniazid   (INH)         r^ 
Rifampin 


Myambutol   (EMB) 
Streptomycin 

^_______^_____     Other  

Has  there  been  any  break  in  this  patient's  chemotherapy?      QvfS        I    I  A/0 
If  yes,  why? 


REFILLS 


Isoniazid   (INH) 
Rifampin 

Myambutol   (EMB) 
Streptomycin 
Other 


DATE   CHEMOTHERAPY  STOPPED: 

□  completed  Therapy 

O  Moved  from  area  to 

□  Lost  -  unable  to  locate 

□  Died     (date)  

□  Non-Compliance 

□  Adverse   Reaction 


DATE  OF    LAST  MEDICAL  EXAM:  

General   Health: 

□  Good  npair  □Poor 

□  improving  □Worsening  □No  Change 

□  weight  Gain lbs.         □  Weight   Loss lbs. 

DATE  OF   LAST  MEDICAL  REVIEW   (No  exam): 


COMMENTS: 


Signed  By: 


Phone   Number: 


PHSB-TB-9  3/81 
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MONTANA  STATE  DEPARTMENT  OF   HEALTH  &   ENVIRONMENTAL  SCIENCES 

INITIAL  TUBERCULOSIS  REPORT 

FOR  NEW  OR   REACTIVATED  CASE  OF  DISEASE 


NAME: 


BIRTHDATE: 


ADDRESS: 
CITY: 


DIAGNOSIS  DATE: 
STATE: 


SEX:     [_|female     r~]male  RACE:    [^ White       |     [American   Indian  Q Other   (specify) _ 


CURRENT  CHARACTERISTICS: 

1.     TUBERCULOSIS  DISEASE:  DYes  DNo 

If  yes,  check  predominant  site  listed  below: 
Q Pulmonary  LJBone  and/or  Joint  [    [Meningeal 

LJ  Peritoneal  I    I  Lymphatic  CU  Miliary 

Significant  site($)  other  than  predominant  site: 


D  Reported  at  time  of  death 


I    I  Pleural                   Q  Genitourinary 
CD  Other  (specify) 


2.     BACTERIOLOGY: 

Smear 
Culture 
Not  Stated 
If  culture  is  positive: 


Positive 

D 
D 
D 


Nogative 

D 
D 
D 


I^MTB     or        [     [other  Mycobacterium  (specify) 


Not  Done 

D 
D 
D 


3.     CHEMOTHERAPY: 

I [Not  on  chemotherapy;  Why? 


I [On  chemotherapy 

Date  started: 


□  isonaizid   (INH) 
I    1  Rifampin 
DWyambutol   (EMB) 
I    IStreptomvcin 
□other  (specify) 


4.     PREVIOUS  TREATMENT  FOR   TUBERCULOSIS  DISEASE:  QVes  (List  year) 

□  No  □  Unknown 

Known  contact  to  tuberculosis  disease:  [ZJYes  (Name  of  contact) 

LJNo  I    [unknown 


5.     X-RA  Y:  □  Normal 

□  Stable 

Cavitary:     [    j  Minimal 


I    [Abnormal 
I    [  Worsening 

I    I  Moderate 


□  Not  Done 
I    [Improving 

I [Far  Advanced 


Report  Comments: 


6.     TUBERCULIN  TEST:  □Positive  □Negative  □Doubtful  □Not  done 

mm  mm  mm 

Type  of  test  done: 


X^ 


Other  medical  problems  under  treatment: 


Reported  By:. 


Phone  Number: 


(i 
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HEPATITIS  A 

OTHER  NAMES:  Infectious  hepatitis,  short-incubation  hepatitis,  epidemic 
hepatitis,  epidemic  jaundice,  catarrhal  jaundice,  viral 
hepatitis  type  A. 

RESPONSE: 
Responsibility  for  investigation  and  followup  -  Nursing  and  Sanitation  Dioision. 
I.  Reported  Disease  —  case  must  be  confirmed  by  a  physician 
A.  Treatment 

1.  Call  should  be  made  to  or  received  from  client's  physician 
to  confirm  case.  (If  out-of-county  clients  they  must  have 
written  physician's  order  to  receive  gamma  globulin.) 

a.  Ask  if  an  Australian  Antigen  test  has  been  performed  and 
with  what  results. 

(1)  If  yes,  with  negative  results,  give  gamma  globulin. 

(2)  If  no,  patient  should  have  the  test  performed  before 
receiving  gamma  globulin 

b.  Obtain  pertinent  data 

(1)  Onset 

(2)  Severity 

(3)  Duration 

(4)  Probable  Source 

(5)  Information  on  how  to  locate  client  for  further 
interviews . 

2.  When  case  is  confirmed  then  give  prophylactic  Gamma  Globulin 
(ISG)  to  patient's  intimate  contacts  if  no  more  than  Ik   days 

have  elapsed  since  exposure. 

a.  Intimate  contacts  are  permanent  or  temporary  household 
residents. 

b.  School  contacts  are  usually  not  an  important  means  of 
transmitting  disease.  However,  if  epidemiologic  study 
shows  that  a  school-  or  classroom-centered  outbreak 
exists,  administer  ISG  to  people  at  risk. 
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-^  c.   Institutional  contacts — prisons,  institution  for  the 

mentally  retarded,  etc.,  favor  transmission  of  Hepatitis 
A.  Administer  ISG  to  residents  and  staff  contacts  in 
case  of  epidemic. 

d.  Hospital  contacts  —  prevention,  such  as  hygienic  practices 
continuing  education  projects  and  routine  precautions  for 
personnel  who  have  close  contact  with  hepatitis  cases, 

as  indicated. 

e.  Office  and  factory  exposure  —  routine  administration  of 
ISG  is  not  indicated  for  people  exposed  in  usual  work 
situtaion  to  hepatitis  case. 

f.  Common  source  exposure  —  when  food,  water  or  other  such 
vehicle  is  identified  as  a  common  source  of  infection  for 
multiple  hepatitis  cases,  administering  ISG  to  others 
exposed  to  same  source  has  not  been  proven  beneficial. 

3.  Dose  for  intimate  contacts  unless  otherwise  indicated  by 
written  doctor  order  — -  administer  deep  IM. 
I  ^  Person's  Weight  GG  Dosage  (ml) 

<50#  0.5 

50  -  lOOif  1.0 

>10G,f  2.0 

h.      If  contact  was  intimate,  fill  out  immunization  card  after 
dose  (see  sample)  and  file  in  monthly 'yellow  fever  fild' to 
be  counted  at  the  end  of  the  month. 

5.  Fill  out  "Communicable  Disease  Case  Study"  and  give  to 
nurse/sanitarian  in  charge  of  hepatitis  A  followup  with 
a  triplicate  copy  sent  to  CDC. 

6.  A  yellow  confidential  case  report  card  must  be  sent  to  State 
Health  Department  weekly  for  each  hepatitis  case. 

B.   Investigation 

1.  Interview  hepatitis  case  or  a  member  of  the  immediate  family 
and  fill  out  "Communicable  Disease  Case  Study"  form. 

2.  Determine  the  list  of  intimate  contacts  so  that  prophylactic 
ISG  can  be  administered  as  soon  as  possible. 
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3.  Insure  that  all  contacts  receive  ISG  as  soon  as  possible. 
Make  appointments  for  contacts  to  come  to  Health  Department 
if  necessary. 

k.     People  diagnosed  as  having  or  clinically  suspected  of  havinp 
infectious  hepatitis  who  are  food  handlers  (waitresses,  cookc 
dishwashers,  butchers,  bakers,  grocery  clerks,  etc.)  must 
be  prohibited  from  working  where  they  have  direct  contact 
with  food  until  they  are  declared  non- infectious  by  either 
their  private  physician  or  the  Health  Officer.  It  is  the 
responsibility  of  the  staff  of  the  Health  Department  to 
enforce  this  policy  thru  the  Health  Officer  or  Sanitation 
Division. 

5.  Review  water  supply  and  sewage  disposal  systems  with  Sanitat-i 
Division. 
C.  Maintain  surveillance  for  additional  cases.  If  individual  sewer, 

do  field  check  to  insure  system  is  working  (if  in  high  hazard 

area).  Take  water  sample  if  on  individual  water  supply. 

DESCRIPTION: 

Agent  an  RNA  virus  found  in  ;xrine,  feces,  blood,  and  other  body  fluids. 

Symptoms  and  course  of  disease:  pre-icteric  stage  characterized  by 
abrupt  onset  of  such  symptoms  as  fatigue,  anorexia  (lack  of  appetite), 
nausea,  vomiting,  abdominal  discomfort  and  distaste  for  coffee  and 
cigarettes.  Physical  examination  at  this  stage  m^  reveal  low  grade 
fever  and  tender  liver  area.  With  the  appearance  of  jaundice,  there  is 
usually  a  decrease  in  the  severity  of  symptoms.  The  patient  is  usually 
afebrile,  but  his/her  liver  remains  palpable  and  tender.  The  feces  are 
often  beige  to  light  brown  and  the  urine  often  dark  yellow  or  brown. 

Mild  or  subclinical  infections  are  common  among  very  young  children, 
while  more  severe  illness  is  generally  seen  in  older  children  and  adults 
and  those  with  other  chronic  or  debilitating  diseases. 

Complications  can  include  chronic  liver  damage  and,  rarely,  death. 

RESERVOIR: 

Humans,  and  rarely,  chimpanzees  and  certain  other  nonhuman  primates. 
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INCUBATION  AND  COMMUNICABILITY: 

Incubation  is  15-50  days  and  commonly  28  days. 

Susceptibility  is  general.  One  attack  is  thought  to  confer  lifetime 
Immunity.  Communicable  period  is  felt  to  be  about  two  weeks  prior  to 
onset  of  symptoms  to  two  weeks  after  onset. 

Diagnosis  is  made  on  the  basis  of  signs,  symptoms  and  history  of  exposure 
in  combination  with  laboratory  results  on  such  tests  as  SGO-T,  SGP-T, 
bilirubin  and  negative  tests  for  hepatitis  B,  mononucleosis  and  other 
clinically  suspected  causes  for  the  illness.  Some  commercial  laboratories 
have  a  test  for  hepatitis  A  antibody  available  (Abbott  Labs).  A  modifi- 
cation of  the  commercial  test  can  detect  whether  the  patient's  Infection 
is  recent. 

CONTROL: 

Health  education  directed  toward  good  sanitation  and  personal  hygiene 
with  special  emphasis  on  sanitary  disposal  of  feces. and  proper  handwashing. 
Proper  sterilization  of  syringes  and  needles  and  other  equipment  is  always 
important  as  well  as  the  use  of  disposable  units  for  parenteral  injections. 

Education  of  patient  and  contacts  regarding  methods  of  spread,  importance 
of  good  personal  hygiene  and  early  identification  and  treatment  of  contocts 

Restriction  of  patient  from  working  in  high-risk  occupations  such  as  feed 
handling,  child  or  health  care.  Patient  may  return  to  work  in  high-risk 
occupation  with  written  permission  from  physician  or  health  officer  statins: 
he/she  is  no  longer  communicable. 

Gamma  globulin  can  be  given  to  intimate  contacts  within  two  weeks  of 
contact  to  diagnosed  case.  Gamma  globulin  may  not  prevent  infection  but 
it  can  reduce  the  severity  of  the  disease  if  the  contact  is  already 
incubating  disease  at  the  time  gamma  globulin  is  administered.  The 
contact  may  develop  mild  or  subclinical  illness  that  is  believed  to 
confer  lifelong  immunity. 

Contacts  who  work  at  high-risk  occupations  must  be  placed  "under  surveil- 
lance" for  the  full  incubation  period  which  is  six  weeks  after  the  lasl, 
exposure  to  diagnosed  case.  This  surveillance  includes  administering 
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f^umiaa  f'lubuJin,  a  limited  plr/vTical  examiu^tioii  (chockln;;-  tho  wlili^jr,  o!' 
the  ey6;:j  for  yoiiowing  at;d  liver  palpitation),  interview  lustory  and  j- 
function  and  periodic  blood  tests  for  liver  function  by  a  physician.  I 
testing,  light  phy:jical  examination  and  interviews  as  to  present  h'-'illl 
status  ,';hould  be  repeated  every  two  weeks  (total  of  throe -ti '"■■.•  '  'u 
the  incubation  period. 
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I  STATE.  Gf  0<;RAI'1IIC   CODi 


O^ 


ATE  CASr      N(5. 


(9)  (10)       (I 


ari/cd  by  law  (Public  Health  Service  Act,  42  USC  24  1  ).  While  ■ 

VIRAL  HEPATITIS  CASE  RECORD 
DEPARTMENT  OF  HEALTH.  EDUCATION.  AND  WELFARE 

PUBLIC  HEALTH  SERVICE 
C  1  N  I  I   R  (  OH   DISEASE  CONTROL 


DO  NOT  WRITE   IN   THIS  BOX 


CDC  CASt;  NO. 


DATE   DFCCIVF 


PATIENT'S  EAST   NAME  (please 


iST   AND  MIDE)Lf    NAME  (v 


)WN  OR  CIT  Y 


EX     (26) 

[:jMale2r;ile, 


(?')    1  [.Iwnitf,  not  „l   Hispanic  Ongin  2  D  B!. 

Amencan  Indian  oi  /Vla'^kan  Natives  D  Asian  or  (', 


■ider    eDHispanic    gUur 


Date  of 

first  symptor 


Mo.  Day 

(29-30)        (31-32) 


s  the  patient  jaundiced?   (33) 

iJves     2  Dno    9    Dunk. 


Was  the  patient  hospitalised?  (34)      i  lJy„s2  [Uno  q  Dl 


1  ^^ 


iljcl,  excluding  needle  sharing,  with  known  jaundiced  person  or  hepatitis  case  during  the  6  months  prior  to  on 

Kis.  3   Dycs,  2  6  mos.  prior  to  onset  4    [jBoth  2  LJno  ^  Gunknown 

yes,  wno.'(36)        1  nilousehold  MeniDor  2  DNonhousehola  Memoer  sQBoth  aGunknc 


2  months  before  i 


(40) 


iDYesoDNogDunknown 


II.  Were  drugs  such  as  narcotics,  barbiturates,  or  amphetamines  i 

to  onset?  (42)  1   DYes,  within  2  mos.  4  Qves.  2-6 

2   DnoI  admitlod,  but  suspected      3  Dno  9  Dunknown 


by  patient  during  the  6  monti 

Jrior  to  onset  5   DBoth 


IV.  Did  patient 
K  yes. 
(a)  Where' N 


ansfusion  of  blood  or  blood  products  in  the  : 


Na 


nset?(43),    □Yes2nNo9nL 
nk  Supplying 


5od  and/or  Cor 


1    Hon    ,   day     .la,.    -_ Z I- 2   rioviT  a  2-7  day  period 

3  Dove,  a  pe,,od  of  8  days  or  moi^       dale^not  nec-ssaiv         9  Dunknown 


^  -„. [ 


(t  )  ('lea'.e  recoid  lln-  nnnih.-i   ol   unil',  ie(  c.'iviKl  in  .ipp, ,  ,pn,.! .    tin  .    (it   nnkno'/^n  write    <)0  )               Whole  BKjod,  p  irked  i^^  1  •  n'    (48-49) 

of   Units  1 

1- 

t;?^-| 

Q 

V.  Did  th«  patient  die  as  a  result  of  hepatitis?    (b6)            !    vi    w.,s  patient  a  food  handler'    (57! 

0 

0 

1    Gvr.-.    2    [J..,.,    9    [.lunkMown                      j                             1    Dycs   2    Dno    9    Dunk.          If   ye.,  where'     „„ 



0 

VII.  In  the  6  niojitj!is_pj;^or_to  the  onset  of  sym^orns  was  the  p.itient  admitted  to  a  hospital?  (b8) 

9 

1    aY..,.w.,„n:.nu,..                      4    [Iy,..,  :■-,. I,.,  prior  to  onset                         -.    V^,^..^.                       2    Un.                9    D,  ,„„„ 

wn 

VIII.  In  the  6  nionlhs  prior  to  onset  of  symptoms  did  the  patient  have  any  of  the  following  procedures  performed' 

Ul 

Y.iS        No         Uiik                                                                Yes         No         Unk. 

Yes             fJo        , 

,59)    Siixieiy   (iixrhKlinrj  denial)                 I     [J    2     [J     9    l.j               (62)     Ear  piercing        1    G     2    □      yD                     (65)    AcupnncSure 

,G      2G    9 

(60)  R«n!dl  work  (cx.lndiiiq  '.urqr^ry)    1    [J    2     □    9    U             (63)    Tattooing            10     2    0      9    □                   (66)    OHu-r  uercut.meou 

(61)  ii-  Plasmapneifsii                                    1    [J    ;     ["]    y    j   ]             (g^j    Oralsuigeiy        1    G     2D     9    D                               cxposure(sk,n  tost 

.     1  D      2  G    9 

b.  11  yc'".,  spocif>    ihe  name                                                                                                                                                                                    tiair  u.inspl.int,  etc 

) 

of  Plasmapnoresis  center                                                                          '^cily 

IX.  Is  the  patient  employed  in  a  health-related  field?  (6;  J        !   l   'Yes  2   Dno   9   Gllnknown 

M  yos,  spicity|68)      iGl'nysKian             2Gnuiso            jLJl  aboratory  or  Medical  Technician              4GDentist                 5  Goental 

Hyqionisl   Or  Assi-M 

6     Gtto-.pdal  Af.end.inl             7   Gnospdal  einpE.yc-  .,.h..i    than  above                 g   Q  Olhei    (Speedy: 

q   G   Unkn 

X.  Is  the  patient  associated  with  a  hemodialysis  unit  or  transplant  program?(69,       1   D  Yes  2   Dno    9  Donknown 

If  V.-.,  '.nc-,  i(y.(70)        1    i  loialysis/lransplant  I'.iii.si-    .7    !    Iljial  vsis/ F  lansplaiU  employ  t-e    3   G  Household  Contac  t  nf  EIliIv  sis/ Tran 

.,plant    Patient 

4    (1  H.,u...-l...l  1(  onlact   ol   Oiilvsis/l,  insnlim    f   mplovee    o   D  Unknown       ^.•'"!?.  ?.',;;;"" 

XI.  Is  the  patient  associated  with  a  nursery  or  day  care  program?    (71)                  )  Qycs     2GN0     9  Gunk.       Name   it 

Mv.-.„..,...i,..      ,,;,,                    ,     i     ](„„d,np,.V. !      Ir.lM.n.    wi,n>h,ldinpoH„,.n                    3    G  ,    n  ,p.  oy  ,■,-               .llM, ,(ch, 

dinpio.ian,      ,!     i. 

co< 

XII.  Was  the  patient's  serum  positive  for  the   t-lepatitis  B  suiljce  antigen  (HB   Ag.  Australia  antigen.   HAA)'(78i]    L.iYci       2    GNn         8  D 

.ot  tested  .0,  9  [G 

'  y 


Cc..,MENTS: 


GYes       2    Gno        g  GNot  tested  to. 


IN  VI  STKiAI  ( 
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^  SALMONELLOSIS 

■"^     OTHER  NAMES:  Food  poisoning,  salmonella. 

CASE  DEFINITION: 
A  salmonella  case  is  defined  as  one  of  the  following:  laboratory  isolation  of 
salmonella  species  and  a  history  of  diarrhea  or  fever,  or  documented  exposure 
to  a  suspected  vehicle  associated  with  an  outbreak  within  three  days  of  ill- 
ness which  includes  fever  and  diarrhea  or  nausea  or  abdominal  pain. 

RESPONSE: 
Report  of  individual  cases  or  outbreaks  are  required.  Upon  receipt  of 
report,  refer  to  Environmental  Health  Division. 

I.  Investigation  (Within  two  days  of  report  unless  a  group  of  cases  is 
reported  simultaneously  -  investigate  as  soon  as  possible  -  or  there 
is  a  high  expectation  of  foodborne  salmonella  -  investigate  immediately.) 
A.  A  separate  file  folder  must  be  established  for  each  outbreak 
(defined  as  2-5  cases  within  one  week  or  within  a  single  group 
having  a  common  contact). 
_)-'         B.  Investigation  should  include  inquiry  of: 
s^  1.  Domestic  water 

a.  Source 

b.  Potability 

c.  Proximity  to  wildlife  and  sewage 

2.  Similar  illnesses  of  family  and/or  group  contacts. 

3.  Presence  of  pets,  poultry  or  livestock. 

4.  General  sanitation  conditions. 

5.  Food  handling  procedures. 

6.  Recent  food  history. 

7.  Recent  travel . 

8.  Laboratory  information  -  group  and  serotype  and  drug  resistance 
pattern. 

9.  Functioning  of  individual  sewer  system  if  in  high  hazard  area. 
10.  Recent  medical  history  including  other  drugs  if  strain  isolated 

has  antibiotic  resistance. 
C.  Interview  for  case  histories  as  necessary  (see  attached). 
-""^         D.  After  investigation,  group  cases  into  most  probable  means  of  spread. 
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1.  Via  food 

2.  Via  pets  or  livestock 

3.  Person-to-person 

4.  Travel -related 

5.  Other  or  unknown 

E,  Food  handlers  who  are  cases  or  carriers  must  not  work  until  two 
successive  negative  cultures  have  been  obtained. 
II.  Post-investigation 

A.  For  every  outbreak  (2-5  within  one  week  or  within  a  single  group 
having  a  common  carrier),  a  short  report  detailing  investigation 
and  results  must  be  written  and  a  file  copy  kept  with  a  copy  sent 
to  the  State  Department  of  Health  and  Environmental  Sciences. 

B.  Cases  or  outbreaks  must  be  reported  to  State  Department  of  Health 
and  Environmental  Sciences  within  seven  days  of  report  by  laboratory 
or  physician. 

DESCRIPTION: 
Agent  is  a  bacterial  genus  salmonella,  with  over  1700  serotypes.  The 
disease  is  generally  characterized  by  sudden  explosive  onset  of  colic- 
like abdominal  pain,  nausea,  vomiting,  diarrhea  and  fever.  Feces  may 
contain  mucus  and  blood.  Dehydration  may  be  severe,  especially  in  very 
young  and  elderly  patients. 

Clinical  manifestations  are  variable:  some  persons  may  be  asymptomatic, 
some  may  have  just  fever  and  bacteremia.  The  infectious  agent  may  localize 
in  any  tissue  of  the  body  producing  abscesses  and  causing  arthritis,  endo- 
carditis, meningitis,  pneumonia,  or  other  organ  infections.  Salmonella 
food  infection  is  distinguished  from  other  foodborne  illness  by  a  longer 
incubation  period  (mean  is  usually  18-24  hours),  fever  and  illness  lasting 
one  to  three  days. 

RESERVOIR: 
Organism  is  found  mostly  in  vertebrates,  both  domestic  and  wild,  especially 
poultry,  vermin  and  pets. 

Many  animal  and  poultry  items  such  as  eggs,  chickens,  turkeys,  pet  foods, 

fertilizers,  etc.,  harbor  the  organism.  Animal  feed  which  has  not  been 

heat-treated  is  an  important  factor  in  the  chain  of  transmission.  Flies 
may  be  vectors. 

Man  may  become  infected  through  contact  with  the  feces  of  patients  and 
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transient  carriers,  especially  mild  and  unrecognized  cases. 

~\  Transmission  is  most  frequently  by  ingestion  of  contaminated  food  or  fluid, 

v^      and  less  often  by  direct  contact  with  an  infected  person,  animal  or  other 
source.  Waterborne  epidemics  have  occurred. 

INCUBATION  AND  COMMUNICABILITY: 
Incubation  period  usually  6  to  72  hours,  commonly  12  to  36  hours,  after 
ingesting  organism.  Localized  infection  (wounds,  etc)  and  septicemia 
probably  occur  within  one  to  seven  days.  Paratyphoid  fever  occurs  from 
1  to  21  days  after  exposure  with  average  incubation  of  14  days. 

Patient  is  communicable  as  long  as  organism  can  be  found  in  blood,  urine, 
stool  -  usually  three  days  to  three  weeks.  Excretion  of  organism  usually 
persists  for  several  days  or  weeks  after  acute  illness.  Antibiotics  may 
increase  duration  of  excretion  or  organism.  A  carrier  state  may  persist 
for  months,  especially  in  very  small  children. 

DIAGNOSIS: 
When  presenting  symptoms  are  gastroenteritis,  isolation  of  causative  organism 
from  the  feces  is  diagnostic.  Bacteremia  or  local  infection  is  diagnosed  by 
_h'  recovery  of  organism  from  blood,  pus,  urine  or  other  body  fluids.  Paratyphoid 

'\>^      diagnosis  is  by  isolation  of  salmonella  species  from  blood,  feces  or  other 
sites.  NOTE:  In  salmonella  septicemia,  30  to  50  percent  of  patients  have 
underlying  disease.  Severity  of  the  disease  is  related  to  the  serotype  of 
the  organism,  the  number  of  organisms  ingested  and  host  factors. 

CONTROL : 
Restrict  infected  persons,  household  and  close  contacts  from  critical 
occupations  (food  handling,  health  and  child  care)  until  two  stool  specimens 
are  negative  by  laboratory  examination  and  have  been  submitted  at  least 
seven  days  apart  and  at  least  seven  days  (according  to  current  State 
recommendations)  after  discontinuing  any  antibiotic  therapy.  Advise  contacts 
of  signs,  symptoms,  obtaining  medical  care  if  needed.  Advise  patient  and 
contacts  regarding  proper  sanitation  of  water,  food  and  waste  products, 
paying  careful  attention  to  personal  hygiene.  Discuss  cooking  and  storage 
procedures  for  all  foods.  Alert  persons  to  the  hazards  of  raw  and  cracked 
eggs  and  raw  milk. 
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Recognition,  control  and  prevention  of  salmonella  infection  in  domestic 
animals  and  pets  should  be  stressed  as  well  as  the  control  of  flies. 

TREATMENT: 

Private  physician. 
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FOODBORNE  DISEASE  INVESTIGATION 


At  the  start  of  the  interview,  an  interviewer  should  introduce  him/herself  and 
explain  the  purpose  of  the  interview  in  terms  of  the  respondent's  needs  and  goals. 
A  rapport  between  interviewer  and  respondent  needs  to  be  established.   The 
interviewer  should  first  ask  a  broad,  open  question  which  is  free  of  leading 
words;  then  the  investigator  should  ask  a  series  of  supplementary  probing  or 
biasing  factors  so  that  the  resondent  can  phrase  the  answer  in  his/her  own 
words;  then  the  investigator  should  ask  a  series  of  supplementary  probing  questions 
to  get  definitions  of  the  terms  used  by  the  respondent  and  a  fuller  description 
of  the  situation;  and  finally,  he/she  should  recapitulate  the  testimony  by  asking 
a  series  of  questions  to  verify  the  answers.   During  the  reply  the  respondent 
should  be  observed  for  nonverbal  communication.   If  answers  do  not  reach  the 
objectives  of  the  questions,  the  interviewer  should  ask  another  question  that  is 
/-^      aimed  at  the  same  objective.   If  answers  are  not  free-flowing,  the  interviewer 
v^^      may  let  a  silence  develop;  in  such  a  situation,  a  respondent  is  inclined  to  speak 
on  his  own  initiative.   The  interviewer  should  be  supportive,  both  verbally  and 
nonverbally,  to  assure  the  respondent  of  his/her  interest  in  the  information  that 
is  given.   The  interviewer  should  also  limit,  as  much  as  possible,  the  communication 
of  redundant  or  irrelevant  information,  but  not  to  the  extent  of  discouraging  new 
of  more  relevant  information. 


Kahn  and  Cannell,  1957 
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GIARDIASIS 

OTHER  NAMES:  Giardia  enteritis,  lambllasls. 

CASE  DEFINITION: 
A  giardia  case  requires  one  of  the  following: 

A.  Laboratory  identification  of  traphozoites  or  cysts  in  stool. 

B.  Diarrhea  for  5  or  more  days  and  treatment  with  flagyl  or  atabrine  followed 
by  clinical  improvement. 

C.  Diarrhea  for  5  or  more  days,  a  history  of  consumption  of  untreated  water 
within  one  month  of  onset  of  illness  and  treatment  with  atabrine  or  flagyl. 

RESPONSE: 
Reports  of  individual  cases  or  outbreaks  are  requested  by  use  of  the  repo^'ting 
form  (sample  page  1)  to  the  Missoula  City-County  Health  Department.  Upon 
receipt  of  giardia  report: 

I.  Staff  member  taking  call  or  report  shall  refer  to  Environmental  Health 
Division  to  the  sanitarian  in  charge  of  foodbome  and  waterbome  disease. 

A.  Investigate  reported  cases  within  two  work  days  of  first  notification 
keeping  separate  file  folders  for  giardia  outbreaks  (outbreak  de- 
fined as  four  or  more  related  cases ) . 

1.  Information  required  is: 

a.  Domestic  water  (source,  proximity  to  livestock,  wildlife 
and  sewage) . 

b.  Other  water  sources  (camping,  etc.). 

c.  Recent  travel/immigration. 

d.  Similar  illnesses  in  family  members  or  group  contacts. 

2.  Use  case  report  form  (attached). 

B.  After  investigation,  classify  cases  tentatively  to  most  probable 
means  of  spread  (list  not  mutually  exclusive). 

1.  Via  domestic  water: 

a.  Provide  sufficient  followup  to  insure  prevention  and  correction 
of  problem. 

b.  If  more  than  one  family  uses  water  supply  -  all  reasonable 
steps  shall  be  taken  to  resolve  problem. 

2.  Via  non-domestic  water  -  provide  individual  with  basic  information 
regarding  safety  of  imtreated  surface  waters  and  means  of  effective 
treatment. 

3.  As  result  of  travel  or  immigration. 
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k.     Person-to-person  spread.  ^i- 

II.     If  domestic  water  ,    take   steps    to   correct   the   situation. 
III.     Sanitarian  in  charge  will  report  to  Montana  Department  of  Health  and 
Environmental  Sciences  all  diagnosed  cases  within  one  week. 
IV.     Write  short  report  for  inclusion  in  outbreak  folder  (for  outbreaks  only). 

DESCRIPTION: 

The  agent  is  giardia  lamblia,  a  flagellated  protozoan. 

Symptoms  range  from  none  to  severe  malabsorption  with  steatorrhea, 
chronic  diarrhea,  abdominal  cramps,  pale,  greasy  malodorous  stools, 
anemia  and  weight  loss.  Children  are  especially  likely  to  develop  a 
chronic,  recurrent  illness  with  diarrhea,  abdominal  pain  and  distention, 
anorexia,  nausea  and  vomiting.  Lactose  intolerance  may  be  present. 

RESERVOIR: 

The  source  is  man,  wild  animals,  and  possibly  domestic  animals. 

Transmission  is  by  direct  fecal-oral  route,  or  through  contaminated  drinking 

water.  Distribution  is  worldwide.  The  rate  of  asymptomatic  carriers 

in  the  U.S.  may  be  as  high  as  twenty  per  cent  in  areas  of  poor  sanitation 

and  in  institutions. 

Life  cycle: 

cysts  are  (6-22  days) trophozoites  multiply cysts  are ^  cysts 

swallowed  in  duodenal  crypts,  formed  in      shed  in 

may  involve  bile  duct  colon         feces 

and  gallbladder 

INCUBATION  AND  COMMUNICABILITY: 

Incubation  period  is  6  to  22  days;  in  waterbome  epidemics  may  be  1-k 
weeks  after  exposure. 

Communicability  lasts  throughout  the  infection. 

DIAGNOSIS: 

Examination  of  stools  for  cysts  or  trophozoites  is  required  (multiple 
stool  samples  are  often  needed  and  concentrated  specimens  may  be  necessary). 
Trophozoites  may  be  found  in  duodenal  aspirates.  iP" 
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CONTROL : 

Cysts  are  resistant  to  chlorlnation,  thus  elimination  of  fecal  contam- 
ination is  necessary.  Careful  handwashing  and  general  hygienic  measures 
are  necessary  in  institutions. 

Investigate  and  examine  feces  of  household  members  and  other  suspected 
contacts  (in  case  of  person-to-person  spread),  supplemented  with  search 
for  environmental  contamination  (in  general,  undiagnosed  cases  are  not  a 
public  health  risk  although  determining  water  source  and  potability  is 
indicated) . 

Hikers  and  backpackers  should  be  advised  about  proper  sanitation  of 
drinking  water. 

TREATMENT: 

At  private  physician. 
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Section  3 

costs  of  conducting 
communicable  disease  programs 


Results  -  Actual  FY  I98O  communicable  disease  program  costs  ranged  from  $470 
for  Missoula's  Hepatitis  A  Program  to  $6842  for  the  TB  Program.   Before  cost 
analysis  worksheets  were  developed,  Missoula  program  costs  were  estimated. 
Missoula  program  administrators  are  now  using  exact  cost  information  for 
program  planning  and  budgeting.   Cost  analyses  will  be  updated  yearly. 

Discussion  -  To  accurately  compute  program  costs,  personnel  should  keep  good 
daily  time  and  mileage  records  and  accurately  track  costs  of  supplies.   You 
can  use  estimates  of  staff  time  and  mileage,  but  the  cost  analysis's  over-all 
accuracy  will  be  reduced. 

Methodology  -  The  first  cost  analysis  sheet,  the  Department  Overhead,  will 
give  you  the  overall   percentage  to  use  to  allocate  general  department  over- 
head to  each  program.   Thorough  instructions  are  printed  on  the  back  of  each 
cost  analysis. 

1.  Department  Overhead  (form  page  3-2,  example  page  3-3) 

2.  Measles  Program  Cost  Anslysis  (form  page  3-4  ,  example  page  3.5) 

3.  Hepatitis  A  Program  Cost  Analysis  (form  pg.  3-6,  example  pg.  3-7) 

4.  Tuberculosis  Program  Cost  Analysi s (form  pg.  3.8  ,  example  3-9) 

5.  Giardia  Program  Cost  Analysis  (form  page  3- 10,  example  pg.3.1l) 

6.  Salmonella  Program  Cost  Analysis  (form  page  3- 12,  example  pg.  3.13) 
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Adm i  n  i  s  t  rat  i  v e    S o  1  a |- 1  c s 

d.  Health    Officer 

b.  Administrative  Assistant 

c.  Administrative  Secretary 

d.  H.D.  Receptionist 

e.  H.D.  Accountant 

f .  Vital  Statistics  Clerk 
q.  Medical  Consultant 

h.  Other: 


Other  Administrative  P ers onnel  Expenses 
Termination  Reserve 


(fringe) 
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Recrui  tment 

General  Conferences  I,   Meetings 

General  Training 

General  Books  &  Periodicals 

Administrative  Travel 
Other: 


other  per 
(FT"  expenses 


OVERHEAD 
Health  Department  Cost  Analysis 


Ch>evhead  is  a  factor  dcsigried  to  calculate,  the  total  costs  of  admin- 
i.ntc.ring  a  program.  It  should  be  noted  that  overhead  La  an  estimatic 
of  the  health  department 's  administration  of  all  department  programs, 
all  of  which  overlap;   hence,    the  need  for  an  overhead  figure. 
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This  means  salaries  plus  appropriate  yearly  fringe  benefits  and  merit  raises 
of  only  personnel  involved  in  the  general  administration  of  the  health  department. 
(Other  personnel  may  be  added  if  other  departments  are  organized  differently. 
For  example,  a  health  department  personnel  director  or  assistant  health  officer 
should  be  added  to  this  category.)  The  receptionist  is  the  person  who  acts  for 
the  entire  health  department,  the  general  office  clerk  (or  a  portion  of  her/his 
salary)  acts  as  vital  statistics  clerk. 

To  calculate  (a),  or  total  administrative  salaries,  multiply  total  salaries 
(which  should  include  yearly  raises)  by  yearly  fringe  percentage. 

Other  Administrative  Personnel  Expenses 

"Termination  Preserve"  means  those  monies  set  aside  to  pay  vacation  and  sick  pay 
severance  to  employees  who  quit.   "Recruitment"  means  costs  budgeted  for  newspaper 
ads,  printing  and  other  costs  of  filling  vacant  positions.   "Conferences  and 
Meetings"  refers  to  those  of  general  interest  to  health  administration  and  not 
applicable  to  a  specific  program.   "Training"  means  general  mangement  or 
administrative  training,  not  that  attributable  to  a  specific  program.   The  "Books 
and  Periodicals"  category  includes  general  health  planning,  public  health,  and 
management  materials  of  general  interest  and  not  attributable  to  a  specific 
program.   "Travel"  means  general  health  department  trips  and  excludes  travel  for 
specific  programs  or  conference  travel  (to  be  included  under  "Conferences  and 
Meetings").   Blanks  are   provided  for  other  categories  specific  to  the  general 
administration  of  a  health  department.   Add  all  these  categories  to  get  Total 
Administrative  Personnel  Expenses  (b). 

Other  Administrative  Expenses 

Expenses  in  this  category  are  those  which  are  general  to  the  running  of  an 
agency.   Since  it  is  virtually  impossible  to  split  out  the  number  of  pencils, 
pieces  of  paper  and  the  like  used  by  one  program  or  activity,  it  is  a  good  deal 
easier  to  include  these  as  a  total  category  and  be  able  to  easily  allocate  them 
In  the  department  overhead  computation.   (The  only  exception  to  this  would  be 
grants  where  administrative  expenses  are  each  listed  and  funded  separately  and 
should  be  allocated  as  such.)   Office  supplies,  copies  and  printing,  postage, 
office  equipment  and  phone  are  total  costs  per  year  for  the  whole  department 
excepting  grant  allocations.   Interest  on  warrbnts  is  interest  paid  on  monies 
borrowed  from  a  bank  to  cover  current  department  operating  expenses  (if  applicable). 
Other  administrative  expenses  should  be  included  in  this  category  if  they  are 
attributable  to  the  general  operation  of  a  department.   (Note:   It  is  more  accurate 
and  easier  to  charge  vehicle  expenses  to  the  program  which  uses  them  on  a  cents- 
per-mile  basis.   It  is  also  a  good  deal  more  difficult  to  charge  phone,  office 
space  and  the  like  out  on  a  program-by-program  basis.) 

Building  and  Maintenance 

Housing  costs  are  to  be  included  in  the  overhead  computation  because  of  the 
difficulty  of  allocating  square  footages,  utilities,  phones,  etc.,  to  each  program 
or  activity.   This  category  should  cover  all  housing  expenses  of  the  department 
and  laboratory. 

Other  Expenses 

This  category  should  include  costs  of  routine  audits,  administrative  consultants, 
depreciation  on  capital,  or  other  similar  items. 


Overhead 
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3-   Other  Administrative  Expenses 

a.  Ai 1  Office  Suppl ies 

b.  All  Copies  and  Printing 

c.  All  Postage 

d.  Office  Equipment  &  Maintenance 

e.  All  Telephone  Charges 

f.  Interest  on  Warrants 

4.   Building  and  Maintenance 

a.  Rent  OR  $ per  sq.  loot 

X   number  of  sq.  feet  of  office, 
lab,  etc. 

b.  Maintenance 

c.  Utilities 

d.  Insurance 


irr 


5.   Other  Overhead  Expenses 
Other: 


bui Iding  and 
(d)   mai  ntenance 


other  expenses 
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TOTAk.  OVERHEAD  COSTS 


Overhead  Computation  =  —  ,  ?  ^  ^  '^  "^Z  ^  "^  !  r  ■ =   OVERHEAD  (30%) 

^  total  H.D.  salaries  +  fringe 


MEASLES 

Cost  Analysi  s 

The  purpose  of  this  cost  analysis  is  to  provide  a  formula  to 
determine  the  costs  to   the  health  department  of  providing  measlea 
immunizations,   surveillanae,   investigation  and  follouup. 


actual 
estimate 


OUTPATIENT  CLINIC  COSTS 

a.   Personnel:  RN  time/iz  x  (salary  +  fringe)  x  #  pts./yr. 


b.   Supplies/pt.  X  total  #  pts. 
vaccine 

needles 

cotton  balls 

other: 


2.   FIELD  WORK  AND  INVESTIGATION 


a.   Personnel:  RN  time/indiv.  case  x  (salary  +  fringe) 
X  #  pts./yr. 


RN  time/outbreak  x  (salary  +  fringe)  x  #  pts./yr 


b.  Mileage  e  iM  . 

c.  Other: 


3.   NURSING  DIVISION  ADMINISTRATIVE  COSTS 
a.   Nursing  Director 


b.  Nursing  Supervisor 

c.  Clerical  support 


A.   OVERHEAD:  %   of  total  salaries  +  fringe 

5.   TRAINING,  BOOKS,  ETC. 
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TOTAL 

PROGRAM 

COSTS 
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EXPLANATION 
Program  Cost  Analysis 


Note:     Each  department  will  have  its  own  system  of  traaking  pepsonnel  time  spent 
on  disease  investigation  and  surveillanae.     The  cost  analysis  worksheet^  designed 
to  provide  the  most  convenient  method  of  determing  program  costs,  can  be  changed 
to  reflect  the  department's  specific  situation. 

1.  Outpatient  Clinic 

a.  Personnel  -  "RN  time"  means  average  time  spent  on  an  "average"  patient. 

This  should  include  filling  out  records  and  reading  tests 
(if  applicable).   You  may  want  to  conduct  a  time  study  to 
give  you  accurate  time  per  patient.   If  more  than  one  nurse 
works  for  the  OPC,  you  should  use  an  average  hourly  salary. 

b.  Supplies  -  This  category  includes  all  supplies  used  for  each  patient. 

Although  the  supplies  cost  could  be  determined  either  by 
dividing  the  total  yearly  supplies  cost  by  the  number  of 
patients  per  year,  or  by  costing  each  supply  used  for  each 
patient,  the  latter  method  is  easier  and  more  accurate. 
Using  the  second  method,  figure  the  cost  of  each  supply  and 
multiply  by  the  number  needed  by  each  patient  and  then  multiply 
that  total  by  the  number  of  patients  seen. 

2.  Field  Work  and  Investigation 

You  need  to  estimate  the  time  the  OPC  nurse  spends  on  a  patient,  although 
a  time  study  would  give  you  more  accurate  nursing  time  spent  per  patient. 
If  you  are  in  an  outbreak  situation  (an  outbreak  defined  as  "two  or  more 
cases  from  the  same  source,  or  by  the  professional  judgment  of  the  nurse"), 
a  white  "Communicable  Disease  Outbreak  Cost  Record"  can  be  used  to  find  the 
exact  time  spent  on  each  case  investigation,  but  be  sure  to  include  all 
time  —  phoning,  in  the  field,  consultations,  professional  reading,  etc. 
The  standard  per  diem  reimbursement  figure  can  be  used  to  figure  mileage  costs. 

3.  Nursing  Division  Administrative  Cost 

This  category  includes  the  costs  of  administering  from  the  nursing  director 
on  down.   To  allocate  costs,  one  of  four  methods  can  be  used  (in  order  of 
preference):  1)  hours  budgeted/spent  by  administrative/ support  personnel; 
2)  percent  of  time  budgeted;  or  3)  best  available  estimate  of  hours  spent. 
To  be  very  accurate,  comprehensive  time  sheets  should  be  kept  by  all  personnel 
and  others  involved  in  case/outbreak  surveillance  and  investigation.   The 
administrative  costs  should  be  the  (number  of  hour^  times  (salary  plus  fringe 
benefits)  for  each  category.   Other  administrative  costs  may  be  added  if 
necessary . 

4.  Overhead 

The  Nursing  Overhead  category  is  designed  to  allocate  the  building,  main- 
tenance, equipment,  and  departmental  administration  costs  as  part  of  the  cost 
of  a  nursing  program.   To  find  the  percentage  figure,  refer  to  the  Overhead 
Cost  Sheet  and  multiply  all  program  personnel  costs  (Including  fringe)  times 
the  overliead  percentage  to  get  the  program  overhead  costs. 

5.  Training,  Books,  Periodicals 

This  category  includes  only  training  or  those  books  and  periodicals  which 
are  specific  to  the  program.   General  costs  should  be  allocated  to  the  general 
overhead  (see  Overhead  Cost  Analysis). 
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HEPATITIS  A 

Program  Cost  Analysis 

The  purpose  of  this  cost  analysis  is  to  provide  a  formula   to 
determine  the  costs  to  the  health  departmen.t  of  providing 
Hepatitis  A  aase/outbreak  investigation  and  surveillanae . 

1.   OUTPATIENT  CLINIC  COSTS 

a.   RN  time/gg  \z   x  (salary  +  fringe)  x  #  pts./yr.  


for  FY 
__  actual 
estimated 


b.  Supplies/pt  X  total  #  pts. 
vaccine 

syringe 
cotton  balls 

c.  Other: 


2.   FIELD  WORK  AND  INVESTIGATION 


a.   Personnel:  RN  time/indiv.  case  x  (salary  +  fringe)  x 
#  pts./yr. 


RN  time/outbreak  x  (salary  +  fringe)  x  # 
outbreaks/yr. 


b.   Mileage  6 


</mI. 


3.   NURSING  DIVISION  ADMINISTRATIVE  COSTS 
a.  Nursing  Director 


b.  Nursing  Supervisor 

c.  Clerical  support 

OVERHEAD:  %   of  tot  sal  +  fringe 


5.   TRAINING.  BOOKS,  ETC. 
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EXPLANATION 
Program  Cost  Analysis 


Note:     Eaah  department  will  have  its  own  system  of  traaking  personnel   time  spent 
on  disease  investigation  and  surveillanae.      The  cost  analysis  worksheet,   designed 
to  provide  the  most  convenient  method  of  determing  program  costs,  can  be  changed 
to  reflect  the  department's  specific  situation. 

1.  Outpatient  Clinic 

a.  Personnel  -  "RN  time"  means  average  time  spent  on  an  "average"  patient. 

This  should  include  filling  out  records  and  reading  tests 
(If  applicable).   You  may  want  to  conduct  a  time  study  to 
give  you  accurate  time  per  patient.   If  more  than  one  nurse 
works  for  the  OPC,  you  should  use  an  average  hourly  salary. 

b.  Supplies  -  This  category  Includes  all  supplies  used  for  each  patient. 

Although  the  supplies  cost  could  be  determined  either  by 
dividing  the  total  yearly  supplies  cost  by  the  number  of 
patients  per  year,  or  by  costing  each  supply  used  for  each 
patient,  the  latter  method  is  easier  and  more  accurate. 
Using  the  second  method,  figure  the  cost  of  each  supply  and 
multiply  by  the  number  needed  by  each  patient  and  then  multiply 
that  total  by  the  number  of  patients  seen. 

2.  Field  Work  and  Investigation 

You  need  to  estimate  the  time  the  OPC  nurse  spends  on  a  patient,  although 
a  time  study  would  give  you  more  accurate  nursing  time  spent  per  patient. 
If  you  are  in  an  outbreak  situation  (an  outbreak  defined  as  "two  or  more 
cases  from  the  same  source,  or  by  the  professional  judgment  of  the  nurse"), 
n   white  "Coramunlcnble  Disease  Outbreak  Cost  Record"  can  be  used  to  find  the 
exact  time  spent  on  each  case  investigation,  but  be  sure  to  include  all 
time  —  phoning,  in  the  field,  consultations,  professional  reading,  etc. 
TVie  standard  per  diem  reimbursement  figure  can  be  used  to  figure  mileage  costs. 

3.  Nursing  Division  Administrative  Cost 

This  category  includes  the  costs  of  administering  from  the  nursing  director 
on  down.   To  allocate  costs,  one  of  four  methods  can  be  used  (in  order  of 
preference):  1)  hours  budgeted/spent  by  administrative/support  personnel; 
2)  percent  of  time  budgeted;  or  3)  best  available  estimate  of  hours  spent. 
To  be  very  accurate,  comprehensive  time  sheets  should  be  kept  by  all  personnel 
and  others  involved  in  case/outbreak  surveillance  and  Investigation.   The 
administrative  costs  should  be  the  (number  of  hour#  times  (salary  plus  fringe 
benefits)  for  each  category.   Other  administrative  costs  may  be  added  if 
necessary. 

4.  Overhead 

The  Nursing  Overhead  category  Is  designed  to  allocate  the  building,  main- 
tenance, equipment,  and  departmental  administration  costs  as  part  of  the  cost 
of  a  nursing  program.   To  find  the  percentage  figure,  refer  to  the  Overhead 
Cost  Sheet  and  multiply  all  program  personnel  costs  (including  fringe)  times 
the  overhead  percentage  to  get  the  program  overhead  costs. 

5.  Training,  Books,  Periodicals 

This  category  Includes  only  training  or  those  books  and  periodicals  which 
are  specific  to  the  program.   General  costs  should  be  allocated  to  the  general 
overhead  (see  Overhead  Cost  Analysis). 
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Program  Cost  Analysis 

The  purpose  of  this  cost  analysis  is  to  provide  a  formula  to 
determine  the  costs  to  the  health  department  of  providing  TB 
oase/outbreak  investigation  and  aurveillanae . 


OUTPATIENT  CLINIC  COSTS 

a.   RN  time/tb  test  x  (salary  +  fringe)  x  #  pts.  tested 
and  read 


b.  Supplles/pt  X  total  #  pts. 

TB  test,  cotton  ball,  record  cost/pt.  x  #  pts. 
TB  test,  cotton  ball,  record  cost/pt.  x  #  pts. 

c.  X-ray  financial  assistance  x  #  pts. 


d.  Other: 


2.   FIELD  WORK  AND  INVESTIGATION 

a.   Personnel:  RN  time/pt.  x  (salary  +  fringe)  x  #  pts. 


b.  Mileage  costs: 

c.  Other: 


li./pt.  x  t/m\ . 


3.   NURSING  DIVISION  ADMINISTRATIVE  COSTS 

a.  Nursing  Director 

b.  Nursing  Supervisor 

c.  Clerical  support 


A.   OVERHEAD:  %   x  tot  sal  +  fringe 

5.   TRAINING.  BOOKS,  ETC. 
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EXPLANATION 
Program  Cost  Analysis 


Note:     Each  department  will  have  its  cMn  system  of  tracking  personnel  time  spent 
on  disease  investigation  and  surveillance.      The  aost  analysis  worksheet,   designed 
to  provide  the  most  convenient  method  of  de terming  program  costs,  can  be  changed 
to  reflect  the  department's  specific  situation. 

1.  Outpatient  Clinic 

a.  Personnel  -  "RN  time"  means  average  time  spent  on  an  "average"  patient. 

This  should  Include  filling  out  records  and  reading  tests 
(If  applicable).   You  may  want  to  conduct  a  time  study  to 
give  you  accurate  time  per  patient.   If  more  than  one  nurse 
works  for  the  OPC,  you  should  use  an  average  hourly  salary. 

b.  Supplies  -  This  category  Includes  all  supplies  used  for  each  patient. 

Although  the  supplies  cost  could  be  determined  either  by 
dividing  the  total  yearly  supplies  cost  by  the  number  of 
patients  per  year,  or  by  costing  each  supply  used  for  each 
patient,  the  latter  method  is  easier  and  more  accurate. 
Using  the  second  method,  figure  the  cost  of  each  supply  and 
multiply  by  the  number  needed  by  each  patient  and  then  multiply 
that  total  by  the  number  of  patients  seen. 

2.  Field  Work  and  Investigation 

You  need  to  estimate  the  time  the  OPC  nurse  spends  on  a  patient,  although 
a  time  study  would  give  you  more  accurate  nursing  time  spent  per  patient. 
If  you  are  in  an  outbreak  situation  (an  outbreak  defined  as  "two  or  more 
cases  from  the  same  source,  or  by  the  professional  judgment  of  the  nurse"), 
a  white  "Communicable  Disease  Outbreak  Cost  Record"  can  be  used  to  find  the 
exact  time  spent  on  each  case  investigation,  but  be  sure  to  include  all 
time  —  phoning,  in  the  field,  consultations,  professional  reading,  etc. 
The  standard  per  diem  reimbursement  figure  can  be  used  to  figure  mileage  costs. 

3.  Nursing  Division  Administrative  Cost 

This  category  Includes  the  costs  of  administering  from  the  nursing  director 
on  down.   To  allocate  costs,  one  of  four  methods  can  be  used  (in  order  of 
preference):  1)  hours  budgeted/spent  by  administrative/ support  personnel; 
2)  percent  of  time  budgeted;  or  3)  best  available  estimate  of  hours  spent. 
To  be  very  accurate,  comprehensive  time  sheets  should  be  kept  by  all  personnel 
and  others  Involved  in  case/outbreak  surveillance  and  investigation.   The 
administrative  costs  should  be  the  (number  of  hour^  times  (salary  plus  fringe 
benefits)  for  each  category.   Other  administrative  costs  may  be  added  if 
necessary. 

4.  Overhead 

The  Nursing  Overhead  category  is  designed  to  allocate  the  building,  main- 
tenance, equipment,  and  departmental  administration  costs  as  part  of  the  cost 
of  a  nursing  program.   To  find  the  percentage  figure,  refer  to  the  Overhead 
Cost  Sheet  and  multiply  all  program  personnel  costs  (including  fringe)  times 
the  overhead  percentage  to  get  the  program  overhead  costs. 

5.  Training,  Books,  Periodicals 

This  category  includes  only  training  or  those  books  and  periodicals  which 
are  specific  to  the  program.   General  costs  should  be  allocated  to  the  general 
overhead  (see  Overhead  Cost  Analysis). 
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GIARDIA 

Program  Cost  Analysis 

The  puppose  of  this  cost  analysis  is  to  provide  a  formula  to 
determine  the  costs  to  the  health  department  of  providing 
giardiasis  aase/outbreak  investigation  and  surveillance. 


1.   PERSONNEL 


a.   Sanitarian  t ime/indi v.  case  x  (salary  +  fringe)  x  #  cs/yr. 


b.   Sanitarian  time/outbreak  x  (salary  +  fringe)  x  §   outbreaks 


c.   Other  personnel : 


personnel 


2.   ENVIRONMENTAL  HEALTH  ADMINISTRATION  COSTS 
a.   Environmental  Health  Director 


'  -3 


b.   Environmental  Health  Supervisor 


c.   Environmental  Health  Clerical  support 


admin, 


3.   MILEAGE 

a.     </ml  X  mi .  X     cases 


b.  c/m\ .    X  mi.  X  outbreak(s) 

k.      TRAINING,  BOOKS.  PERIODICALS  (specific  only) 
5.   OVERHEAD:    %   of  tot.  salaries  +  fringe 


mi leage 
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EXPLANATION 
Program  Cost  Analysi: 


Note:   Each  department  will  have  its  own  system  of  tracking  personnel  time 
spent  on  disease  investigation  and  surveillance.      The  cost  analysis  work- 
sheet,  designed  to  provide  the  most  convenient  method  of  determining  program 
costs,   can  he  changed  to  reflect  the  department's  specific  situation. 


1.  Personnel 


If  more  than  one  staff  member  is  responsible  for  disease  surveillance 
and  investigation,  you  may  need  to  use  an  averaged  salary  figure.   If 
actual  time  spent  on  each  case/outbreak  is  not  recorded  routinely,  use 
the  best  estimate  available.   An  outbreak  is  generally  defined  as  "two 
or  more  cases  from  the  same  source,  or  by  the  professional  judgment  of 
the  sanitarian."  The  heading  "Other  Personnel"  may  include  nurses  or  other 
health  department  investigators. 


Environmental  Health  Administration  Costs 

This  category  is  designed  to  include  the  costs  of  administering  a 
program  from  the  environmental  health  director  on  down.  To  allocate 
costs,  one  of  four  methods  can  be  used  (in  order  of  preference): 
1)  hours  budgeted/spent  by  administrative/support  personnel ;  2)   percent 
of  time  budgeted;  3)  best  available  estimate  of  hours  spent.  To  be  very 
accurate,  comprehensive  time  sheets  should  be  kept  by  all  environmental 
health  personnel  and  others  involved  in  case/outbreak  surveillance  and 
investigation. 

The  administration  costs  should  be  (number  of  hours)  x  (salary  plus  fringe 
benefits)  for  each  category.  Other  administrative  cost  categories  may  be 
added  as  necessary. 


3.  Mileage 

If  records  are  not  kept,  an  average  mileage  may  be  estimated  per  case  and 
per  outbreak.  Mileage  charges  are  generally  held  to  be  the  per  diem 
reimbursement  the  federal/State  government  uses. 

4.  Training,  Books,  Periodicals 

This  category  is  to  include  only  training  or  those  books  and  periodicals 
(journals,  trade  publications,  etc.)  which  are  specific  to  the  program. 
General  public  health  training,  books  and  periodicals  should  be  allocated 
on  the  Overhead  Cost  Analysis. 

5.  Overhead 


The  Environmental  Health  Overhead  category  is  designed  to  allocate  the 
building,  maintenance,  equipment,  and  departmental  administration  costs 
as  they  are  costs  of  environmental   health  programs.   To  find  the 
percentage  figure,  refer  to  the  Overhead  Cost  Sheet  and  multiply  all 
program  personnel  costs  (including  fringes)  times  the  overhead  percentage 
to  get  program  overhead  costs. 
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b.  EH   Supervisor  " 

c.  EH  Clerical    Support  ^S" - 
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Program  Cost  Analysis 

^  "**-  "^  The  purpose  of  this  cost  analysis  is  to  provide  a  formula  to 

determine  the  costs  to  the  health  department  of  providing 
salmonella  case /outbreak  investigation  and  surveillance. 


1 ,   PERSONNEL 


Sanitarian  time/indiv.  case  x  (salary  +  fringe) 
#  cases/yr. 


b.  Sanitarian  time/outbreak  x  (salary  +  fringe)  x  #  outbreaks   

c.  Other  Personnel  personnel 

2.   ENVIRONMENTAL  HEALTH  ADMINISTRATION  COSTS 

a.   Environmental  Health  Director  


I     M^.   Environmental  Health  Supervisor  

c.   Environmental  Health  Clerical  support  admin. 

3.   MILEAGE 

a.     (/mi.  X  ml.  X     cases  


b.  </mi.  X  mi  .  X  outbreak(s)  mileage 

i».   TRAINING,  BOOKS.  PERIODICALS  (specific  only)  train. 

5.   OVERHEAD:  %   of  tot.  sal.  +  fringe  oh 
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EXPLANATION 
Program  Cost  Analysis 


Note:   Eaoh  department  will  have  its  own  system  of  traoking  personnel  time 
spent  on  disease  investigation  and  suvveillanae.      The  cost  analysis  work- 
sheet ,   designed  to  provide  the  most  convenient  method  of  determining  program 
costs,   can  be  changed  to  reflect  the  department's  specific  situation. 


1 .  Personnel 


If  more  than  one  staff  member  is  responsible  for  disease  surveillance 
and  investigation,  you  may  need  to  use  an  averaged  salary  figure.   If 
actual  time  spent  on  each  case/outbreak  is  not  recorded  routinely,  use 
the  best  estimate  available.  An  outbreak  is  generally  defined  as  "two 
or  more  cases  from  the  same  source,  or  by  the  professional  judgment  of 
the  sanitarian."  The  heading  "Other  Personnel"  may  include  nurses  or  other 
health  department  investigators. 

2.  Environmental  Health  Administration  Costs 

This  category  is  designed  to  include  the  costs  of  administering  a 
program  from  the  environmental  health  director  on  down.  To  allocate 
costs,  one  of  four  methods  can  be  used  (in  order  of  preference): 
1)  hours  budgeted/spent  by  administrative/support  personnel;  2)   percent 
of  time  budgeted;  3)  best  available  estimate  of  hours  spent.  To  be  very 
accurate,  comprehensive  time  sheets  should  be  kept  by  all  environmental 
health  personnel  and  others  involved  in  case/outbreak  surveillance  and 
investigation. 

The  administration  costs  should  be  (number  of  hours)  x  (salary  plus  fringe 
benefits)  for  each  category.  Other  administrative  cost  categories  may  be 
added  as  necessary. 

3.  Mileage 

If  records  are  not  kept,  an  average  mileage  may  be  estimated  per  case  and 
per  outbreak.  Mileage  charges  are  generally  held  to  be  the  per  diem 
reimbursement  the  federal/State  government  uses. 


4.  Training,  Books,  Periodicals 

This  category  is  to  include  only  training  or  those  books  and  periodicals 
(journals,  trade  publications,  etc.)  which  are  specific  to  the  program. 
General  public  health  training,  books  and  periodicals  should  be  allocated 
on  the  Overhead  Cost  Analysis. 

5.  Overhead 


The  Environmental  Health  Overhead  category  is  designed  to  allocate  the 
building,  maintenance,  equipment,  and  departmental  administration  costs 
as  they  are  costs  of  environmental   health  programs.   To  find  the 
percentage  figure,  refer  to  the  Overhead  Cost  Sheet  and  multiply  all 
program  personnel  costs  (including  fringes)  times  the  overhead  percentage 
to  get  program  overhead  costs. 


for    FY  /f^O 

__  est  i mated 


SALMONELLA 
Program   Cost   Analysis 

"he  purpoae  of  this  ■joat  annlysio  ia   to  prouide  a  formula  to  detezmine 
the  aoati:   to   thr  hp.al th  department  of  prooi.din<i  nalmonella  oase/rut- 
hrp.ak  invatiti  nthm  .-md  nwi'pi'^ Icoioc. 


a.  Sanitarian  hourly  time/individual  case      j 

X  (salary  +  trinne)  x  "  cases  yearly        /  /^  ^ 
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/  (7.Wf /.2V)/i   •=. 

b.  Sanitarian  hourly  time/outbreak  x 

(salary   +   fringe)    x   *  outbreaks  3bQ 

n-iohrf-  n/:)  ens  *  /zv; 

c.  Other  Personnel:  ¥S0 
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2.  ENV  HEALTH  ADMINISTRATION  COSTS 

a.  EH   Director  J ^f 

b.  EH   Supervisor  _  .  - 

.^^^v^  .t**x-<,  (>iiA.  (flj; 

c.  FH  Clerical  Support  ^^ 


3-  MILEAGE 

a.  C/mi  .  y  mi  l,--  »  c.)  c  ,       ,    ,  / 
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_^  mi  leage 
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SECTION  l\ 
REFERRALS  FOR  SERVICE  -  PROTOCOL  AND  REFERRAL  RECORD 

Results  -  A.  Protocol:   The  Missoula  Health  Department  did  not  have  a  written 
guide  describing  acceptable  and  non-acceptable  referrals  until  the  Referral 
Protocol  (page  k.2)   was  developed.   The  protocol,  intended  to  quantify  what 
types  of  patients  and  under  what  conditions  referrals  for  service  are  to  be 
accepted,  helps  insure  agency  consistency.   The  Department  was  also  concerned 
with  a  low  acceptance  to  referral  ratio.   The  protocol  is  currently  being  tested 
in  Missoula  until  approximately  October,  I98I  to  determine  if  it  is  accurate, 
workable,  and  complete.   Analyzing  referral  forms  will  show  whether  or  not  the 
protocol  is  being  used  effectively. 

B.  Referral  Record:   The  Record  (page  ^.5)  also  insures  consistency  and  accuracy 
in  telephone  referrals  from  both  health  professionals  and  the  public.   A  referral 
log  (cited  in  the  original  evaluation  plan,  Section  6)  vrauld  also  be  effective, 
but  the  advantage  of  a  two-part  Referral  Record  is  that  one  copy  can  be  kept 
for  a  referral  file  and  one  copy  can  be  routed  to  the  nurse  who  is  assigned  to 
handle  the  case.   The  Record  has  been  proven  to  be  very  effective  when  it  is 
filled  out  completely. 

Discussion  -  The  purpose  of  both  the  Protocol  and  Referral  Record  is  to  insure 
program  consistency.   Home  Health  administrators  felt  that  there  was  too  much 
time  wasted  with  referrals  that  v,(ere  not  admitted  to  the  caseload  (h5%   of 
referrals  were  on  patients  who  were  not  added  to  the  caseload),  so  both  the  Protocol 
and  Referral  Record  are  seen  as  a  way  to  correct  this  problem. 

Methodology  -  A.  Protocol:   The  Protocol  should  be  reviewed  by  nursing  staff 
and  clerical  personnel  in  a  training  session  or  staff  meeting.   After  it  has  been 
used  for  six  rronths  (or  quarterly),  it  should  be  evaluated  for  effectiveness. 
One  way  to  evaluate  the  Protocol  is  to  see  if  the  percentage  of  cases  accepted 
to  total  referrals  has  improved. 

B.  Referral  Record:   To  be  serviceable,  a  record  must  be  completely  filled  out 
for  each  referral.   It  can  be  designed  so  that  a  home  health  nurse  or  supervisor 
receives  one  copy,  while  the  other  copy  is  filed  for  a  permanent  record.   Referral 
Records  should  be  reviewed  at  set  time  periods  to  insure  they  are  being  filled 
out  completely  and  to  gather  home  health  statistics. 
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TWO-YEAR  OLD   IMMUNIZATION  SURVEY 
MISSOULA  COUNTY  AND  MONTANA 


The  data  for  these  tables  is  taken  from  the  State  Health  Department's  report: 

"Twenty-Four  Month  Survey  for  19 Births:  Immunization  Program,"  which  is 

kept  by  Bruce  DeSonia,  Field  Epidemiologist. 

Missoula-Specific  Data 

1.  Polio  data  is  found  under  "Surveyed  Children  Receiving  Polio  Vaccinations 
(Three  (+)  Vaccination).   By  county.   See  Attachment  I. 

2.  DPT  data  is  found  under  "Surveyed  Children  Receiving  DPT  Vaccinations 
(Three  (+)  Vaccination).   By  county.   See  Attachment  II. 

3.  Measles  and  Rubella  are  found  on  the  same  page,  "Surveyed  Children  Receiving 
Measles  and  Rubella  Vaccinations."  By  county.   See  Attachment  III. 

Montana-Specific  Data 

This  data  can  be  found  one  of  two  places  and  provides  for  a  good  double-check  on 
the  accuracy  of  figures. 

1.  At  the  bottom  of  each  of  the  above-listed  pages,  a  total  is  given.   The  total 
equals  the  State's  percentage.   See  Attachment  IV. 

2.  A  summary,  "Survey  Results  -  Immunization  Levels  for  Two-Year  Olds,"  lists 
the  State's  percentage  and  should  equal  the  total  percentage  given  at  the 
bottom  of  each  individual  immunization  page.   See  Attachment  V. 

3.  If  the  totals  do  not  equal,  add  the  average  percentage  (separated  from 
individual  percentages  by  a  }  )  and  divide  by  the  number  of  percentages  used. 
This  is  the  correct  percentage  to  use. 
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TWO-YEAR  OLD   IMMUNIZATION  SURVEY 
MISSOULA  COUNTY 


<i 


1974^ 

1975^ 

1976^ 

4 
1977 

1978^ 

1979^ 

1980^ 

1981 

1982 

1983 

Polio  (3+  doses) 

85% 

87% 

89% 

83% 

86% 

-- 

89% 

DPT  (3t  doses) 

93% 

95% 

94% 

91% 

93% 

-- 

94% 

Measles 

73% 

76% 

89% 

89% 

94% 

-- 

93% 

Rubella 

65% 

69% 

85% 

90% 

93% 

-- 

91% 

Born  in: 

January- June, 
2 January- June , 
3 January- June , 
•^  January- June, 
5 January- June, 


1972 
1973 
1974 
1975 
1976 


6no  Survey  for  1977 
'January-June  1978 


TWO-YEAR  OLD   IMMUNIZATION  SURVEY 
MONTANA 


1974^ 

1975^ 

1976-^ 

1977^ 

1978^ 

1979^ 

1980'' 

1981 

1982 

1983 

Polio  (3+  doses) 

70% 

73% 

78% 

88% 

88% 

-- 

91% 

DPT  (3+  doses) 

78% 

83% 

86% 

94% 

94% 

-- 

94% 

Measles 

81% 

80% 

83% 

92% 

90% 

-- 

91% 

Rubella 

79% 

75% 

78% 

90% 

89% 

~" 

89% 

Born  in: 

Manuary-June,  1972 

2 January- June,  1973 

3 January- June,  1974 

^January- June,  1975 

5 January- June,  1976 


%o  Survey  for  1977 
'January-June  1978 
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ATTACHMENT  I 
SURVEYl-L)  CHILDREN  RECEIVINC  1\)E10  VACCINATION'S 


County 
Yellowstone 
Cascade 
Mia  sou la 

Hill 
Fergus 

Flathead 
Lincoln 

Lake 

Silver    jIow 
^      Lewis    S    Clark 
Gallatin 
Deer    Lodge 

Valley 
Dawson 
Custer 
Roosevelt 

TOTALS 


No 
Vaccinations 


0 

0 

2 

21 

1 

n 

3 

4% 

ii 

11% 

7 

11% 

1 

4% 

6% 


8% 


4% 


2% 

y/. 

37. 

11 

OZ 

0 

U 

0 

0 

0 

0 

One 
Vaccination 

3   3%   .-Aj, 

10   10% 

1    1% 


5% 


8% 


Vaccinations 
16   16% 
23   22% 
13  11% 

20   27%^ 

V27% 
10  28%  j 


25   3% 


46   6% 


18% 


Tlircc  (+) 
Vaccinations 

81   81% 

69  66% 

106  87% 


48  64% 


(>n 


19 

53%  J 

50 

78%  \ 

11 

46%  ^ 

,72- 

20 

83%^ 

I 

33 

77%  ^ 

29 

85% 

,  72/ 

19 

66% 

6 

40%  , 

19 

62%  N 

28 

77%  ) 

V73? 

28 

78% 

18 

75%  ^ 

584 

73% 

v.^*  '  ^ 


h.k 


(» 


County 

Yellowstone 

Cascade 

Missoula 

Hill 
FcrnuG 

Flathead 

Lincoln 

Lake 


ATTACHMENT    II 
.SIJRVKYKU  CHILDRICN   RECEIVING   DI'T   VACCINATIONS 


Vacc  Illations 


«1 


8% 


(.l\ 


One 
Vaccination 


Two 
Vaccinations 


Three  (-f) 
Vaccinations 


51   68%\ 


68'i 


69% 


57  89X^ 

17   68%}>857., 

22  92%  ) 


Silver  Bow 
Levis  &  Clark 
Gallatin 
Ueer  Lodge 


3% 


■8a; 


Valley 
Dawson 
Cu.ster 
Roosevelt 

TOTALS 


37    5% 


80   10% 


h.5 


d 


9 


<^ 


D 


^"1^ 


ATTACHMENT  III 
SURVEYLU  Cilll-DKEN  RECEIVING  MCAl^LliS  AND  RUBKLl-A  VACCINATIONS 


Measles 
County  Vaccination 


Yellowstone  88  88% 

Cascade  88  85% 

Missoula  92  76% 

Hill  60  80% 

Fergus  27  75% 


78% 


Flathead 

Lincoln 

Lake 

Silver  Bow 
Lewis  ix   Clark 
Gallatin 
Deer  Lodge 

Valley 
Dawscn 
Custer 
Roosevelt 

TOTALS  634   80%  596   75% 


R 

iil)el  la 

Vn 

ccinatl 

on 

8/. 

84% 

83 

80% 

83 

69% 

57 

76%  '\ 

7A% 

25 

69%  j 

39 

61%  \ 

14 

3«  1 

r60% 

15 

63%  / 

1 

37 

86%  A 

30 

88% 

•  87% 

25 

sex 

13 

87%  j 

25 

81%  \ 

30 

83%  1 

►  72% 

20 

56% 

16 

67%  / 

i-i:'S 


k.e 
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ATTACHMENT  IV 

SURVEYED  CUlLDlUiN  RFXEIVING  MKASLKS  AND  RUBF-LI A  VACCINATIONS 

Measles  Rubella 

County                          Vaccinotiun  Vaccination 

Yellowstone                   88   88%  84   84Z 

Cascade                      38   83%  83   80% 

Missoula                       92   76a  83   69% 

Hill                          60   80%  ^  57    76% 

7«%  V  74% 


Fergus  27   7  5%  j  25   69% 

Flathead 

Lincoln  16   64%  V  72% 

Lake 


Silver  Bow  37  86% 

Lewis  &  Clark  30  88% 

Gallatin  24  83% 

Deer  Lodge  14  93% 

Valley 
Dawson 
Custer 
Roosevelt 

TOTALS  634   80% 


37% 


25 

81% 

31 

86% 

19 

53% 

18 

75% 

73% 


If  a  particular  immunization  total  (Attachment  IV)  does  not  equal  the  percentage  given  in 
Attachment  V,  add  the  average  county  percentages  for  that  particular  immunization  and  divide 
by  the  total  number  of  percentages  used. 

EXAMPLE:   If  the  Measles  percentage  did  not  equal,  to  find  which  percentage  to  use: 
add    1  -  88%  divide:    559 


2  -  85% 

3  -  76% 

4  -  78% 

5  -  72% 

6  -  87% 

1'.-  IVL  '    .     <    ,  ,  ^ 


^  =  79.85%  =  80% 
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ATTACHMENT  V 
MONTANA 

SURVKY   IlESUl/rf>   —   Inuauniz.it ion   Luvoln   for      Two-Ynar  GUIs 


Polio  (3+  dosts) 

DPT  (3+  dosts) 

Measles 

Rubella 

Polio  (3+),  DPT  (3+) 
Measles  and  Rubella 


V)IU   Rgsu 

Its  * 

1975  Results 

*ft 

Percent 

Percent 

70% 

73% 

797. 

83% 

81% 

80% 

79% 

75% 

60% 


62% 


t 


*  January  -  December,  1972 
**  January  -  June,  1973 
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Section  5 
outbreak  outcome 

Results  -  During  the  evaluation  test  period,  Missoula  County  had  just  one 
outbreak.   The  salmonella  outbreak  (July  -  September  I98O)  cost  the  health 
department  $11,AlO  and  involved  over  977  hours  of  staff  time.   The  outbreak 
not  only  was  a  trial  by  fire  for  the  new  reporting  system,  but  strengthened 
the  communicable  disease  team  and  department  outbreak  procedures.   The 
communicable  disease  team  reviewed  the  salmonella  outbreak  records  for  speed, 
accuracy,  effectiveness  and  outcome  of  Department  response.   The  team  stressed 
that  the  Department  should  more  closely  follow  protocols  for  investigation 
(result:  Salmonella  Protocol ,  page  2.21  and  Communicable  Disease  Reporting 
Protocol,  page  I.'*),  so  that  all  staff  working  on  the  outbreak  know  their 
responsibilities.   The  speed,  accuracy,  and  effectiveness  of  Department  response 
was  judged  to  be  adequate. 

Discussion  -  In  the  midst  of  an  outbreak,  it  is  hard  for  staff  to  remember  to 
carefully  track  their  outbreak  hours,  mileage  and  supplies.   If  your  department 
routinely  keeps  complete  staff  time  records,  your  chances  of  having  accurate 
outbreak  cost  information  are  better.   If  not,  be  sure  to  remind  staff  to 
report  their  time  and  mileage. 

Methodology  -  The  outbreak  record  (page  5.2)  is  designed  to  record  outbreak 
staff  time  and  mileage  if  your  department  does  not  have  other  records  in  use. 
All  staff  members  involved  in  outbreak  investigation  should  carefully 
record  their  time  and  mileage.   Mileage  multiplied  by  the  standard  rate 
(usually  $.20/mile)  and  time  multiplied  by  hourly  wage  plus  fringe  benefit 
equals  personnel  cost. 

The  outbreak  cost  analysis  (page  5.3)  includes  other  department  inputs  — 
administrative  costs,  overhead,  and  supplies.   A  worksheet  to  compute  depart- 
ment overhead  is  included  to  insure  allocation  of  general  expenses  such  as 
department  administration  (health  officer,  accountant,  administrative  support 
staff  input),  utilities,  rent,  general  training,  etc.  See  3-2  of  this  Guide. 

An  outbreak  report,  also  part  of  the  outcome  evaluation,  is  shown  on  page  5.5. 
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OUTBREAK  COST  ANALYSIS 

Thz  pu/ipoiz  o{i  tkU  ao&t  analij&Aj>  -c6  to  pA.ovi.dz  a  lonmuJbx.  to  deXeJunino. 
the.  co6tb  to  thz  hzaZth  dzpa/Umznt  0){  pfiovldlng  outbfizak  Invz^tigatioM. 

1.  PERSONNEL 

a.  RN  time/outbreak  x  (salary  + 

fringe)  x  #  outbreaks  

b.  Sanitarian  hourly  time/outbreak 

X  (salary  +  fringe)  x  #  outbreaks        

c.  Laboratory  technician  time/outbreak 

x  (salary  +  fringe)  x  #  outbreaks        

d.  Other  personnel:  

2.  ADMINISTRATION  COSTS 

a.  EH  Director  

b.  Nsg.  Director  

c.  Nsg.  Supervisor  

d.  Clerical  support  


miles  X  outbreaks  (RN) 
miles  X  outbreaks  (San) 


MILEAGE 

a.  c/mi.  X 

b.  c/mi.  X  

c.  Other: 

OUTBREAK  SUPPLIES 

a.  supplies/pt  x  total  //  pts. 
(list  supplies) 

b.  laboratory  supplies/pt  x  total 
//  pts.  (list  supplies) 

c.  Other:  (list) 

OTHER 
(list) 


personnel 


6.   OVERHEAD  @ 


%  X  tot.  salaries  +  fringe 


admin,  costs 


mileage 


supplies 

other 
overhead 


TOTAL  OUTBREAK  COSTS 


5.3 


(T 


(t 


(Sj 


Outbreak :  yJd^n^^Q-TfgyUil^ 
Dates:  _7/,?0        to  q/gj^ 


(fO    oay^^UnuU) 


OUTBREAK  COST  ANALYSIS 


The  puxpcf>t  oi  thi6  coit  amdjiU   it,  to  provide  a  f^aimula  to  dttcnmi.M 
tht  co6t^  to  thz  hzaJUh  d^paitimnt  o(^  pnovlding  oatbizak  lnvz,ytiga.tion6. 


O 


RN  time/outbreak  x  (salary  + 
frinp.c)  X  it   outhroaks 

Sanitarian' hourly  time/outbreak 
X  (salarv  +  frlnKe)  x  ''   outbreaks 

Laboratory  technician  time/outbreak 
X  (salary  +  frinjr,e)  x  /'  outbreaks 

Othor  personnel : 


ADMINISTRATION  COSTS 

a.  EH  Director         H   "^A^iC  tS'./i  Sa/.+  'fr. 

b.  Nsg.    Director    JO    i/t*, ^  I3.$S<  SU  r  jr. 

c.  Nsg.    Supervisor    iQ -U^i(  l\-13 S»f.-t  ^■ 


55^ 


Clerical   support        H^fo^i^  *■   S.»4 SBULth         /^iS 8 


MILEAGE 

^-   ^C/nl.  X  5p  miles  x  outbreaks/  (RN) 

b.  /fc/mi.  x^'^niilcs  x  outbreak^  (San) 

c.  Other:  j. 


OUTBREAK  SUPPLIES 

a.  supplies/pt  x  total  #  pts. 
(list  supplies) 

b.  laboratory  supplles/pt  x  total 
#  pts.  (list  supplies) 

c.  Other:  (list) 

OTHER 

(lisV)   ^-... 


6.   OVERHEAD  0  30%  x  tot.  salaries  +  fringe 


-US 


Ai>PA 


OnteA.  toils  —  yto.Lik 


lOTkl   OUTBREAK  COSTS 


^.k 


S7}>  7  personnc  L 


-^9/£  adniin. 


/g  mileage 


/^i" 


supplies 


—  J!r  _  ether 
_^ol^_$_   overhead 


^lU 


.^^V  OTHER  SALMONELLA  COSTS 

<^  Federal,  State,  Other  Local  Agencies      ^ 

Patients'  Costs  .^"^ 


^^'' 


Center  for  Disease  Control 


1  staff  (3  $15/hr  x  40  hrs  $600 
Airfare,  Seattle-Missoula  160 

Lab,  Atlanta  (15  samples  (a  $10)  JL50            $910 

State  Agencies 

Livestock,  Helena  (2  staff)  55  hours  total   @  $15  $825 

Travel  166 

Livestock,  Missoula  (2  staff)  50  hours  total   @  $12  600 

Livestock,  Lab  (150  samples  @  $10)  1500 

Livestock,   Ronan  (1  staff)  25  hrs  @  $15  374 

Travel   (3  days  (3  50  miles)  54 

State  Health  Department,  Preventive  Health  Services  160 

(16  (9  $10)  +  (40  (3  $20)  960 

Travel   (5  trips  0  230  miles  each)  207 

State  Health  Department,  Butte  Epidemiologist  150                                             (£ 

(15  P  $10)  +  280  miles  50                                               ^1, 

State  Health  Department,  Missoula  Epidemiologist 

(95  hrs  (3  $10)  950 

State  Lab  (30  samples  @  $15)  450          $6447 

County  Attorney 

16  hours  X  $10/hr  $160            $160 

Salmonella  Patients 

15  patients  hospitalized  -  average  4  days  @  $225^^^^'  ^^^^^3,500 

2  patients  couldn't  work  for  3  weeks:   540  @  $4.50/hr; 

870  (3  $7.25/hr.  1,410 

Other  lost  wages  -  estimated  @  2  days  for  26  of 

working  age  2,080        $16,990 

Total    "Other"  $24,507 
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A  COMMON  SOUKCK  OIJTBRKAK  OF  MULT  I  I'll:  DKliO  RKSISTANT 
SALMONELLA  TYPH J  MURIUM  -  MONTANA 

All  outbreak  of  SalmoneJ_la_  typhimurium  gastroenteritis  epidemlologically 
linked  to  a  local  dairy  selling  raw  cow's  milk  occurred  June  25  -  Aug.  3, 
1980  In  Missoula,  Montana. 

The  increased  gastrointestinal  illness  resulting  from  this  organism  was 
first  noted  in  late  June.   During  the  course  of  the  outbreak,  active  surveil- 
lance identified  77  cases  of  gastroenteritis,  froni  which  Salmonella  Group  B 
was  isolated.   Fifteen  patients  were  iiospi  tal  i /;ed .   An  additional  28  presump- 
tive cases  were  identified  through  public  inquiry  and  surveillance. 

Demographic  data  and  food  histories  were  obtained  by  means  of  a  question- 
naire survey  administered  in  July  and  early  Augu.'-.t  to  all  confirmed  and 
presumptive  cases,  as  well  as  to  age  and  sex  matched  neighborhood  controls 
selected  by  confirmed  cases.   In  addition,  the  survey  was  administered  to 
a  second  control  group  (laboratory  controls)  made  up  oi  age  and  sex  matched 
individuals  with  recent  stool  samples  or  rectal  swabs  negative  for  Salmonella. 
In  addition  to  the  77  confirmed  cases  and  the  28  presumptive  cases,  40 
iieighborhood  controls  and  37  laboratory  controls  were  surveyed. 

A  confirmed  case  was  defined  as  a  person  with  diarrhea  or  abdominal 
cramps  or  fever  from  whom  Salmonella  Group  B  was  isolated,   A  presumptive 
case  was  defined  as  a  person  with  an  onset  of  illness  between  June  15  and 
August  15,  lasting  two  or  more  days  and  consisting  of  abdominal  cramps  or 
diarrhea  and  fever. 

The  77  confirmed  cases  ranged  in  age  from  3  weeks  to  71  years  (median 
14  years),  35  were  male,  and  42  were  female.   Sixty-four  (64)  lived  in  the 
Missoula  metropolitan  area,  8  lived  within  50  miles  of  Missoula,  and  5 
occurred  in  patients  more  than  50  miles  distant.   Of  the  confirmed  cases, 
96%  reported  diarrhea,  92%  fever,  86%  abdominal  cramps,  66%  headache, 
50/5:  chills,  49%  nausea,  and  32%  vomiting. 

Tlie  questionnaire  requested  a  history  of  food  consumption  during  tlie 
three  days  preceding  onset  of  illness.   59  of  77  (77%)  confirmed  cases, 
22  of  28  (79%)  presumptive  cases,  6  of  40  (15'?j  neighborhood  controls,  and 
9  of  37  (24%)  laboratory  controls  had  consumed  raw  milk  from  the  area's 
only  licensed  raw  cow's  milk  dairy  within  that  period.   Of  people  surveyed, 
those  who  reported  buying  raw  milk  were  questioned  regarding  the  source 
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oi    the  milk  purchased  and  their  knowledge  of  oth(>r  raw  milk  sources  Jn 
the  community.   SeveraJ  ether  raw  milk  producers  selling  small  volumes  were 
identified;  none  ol"  those  ill  had  consumed  milk  from  these  other  sources. 
The  relationship  hetwecn  raw  milk  consumption  and  illness  was  significant 
when  confirmed  cases  wc>re  compared  to  neighboiiiood  controls  (p  <.01),  and 
also  when  compared  to  laboratory  controls  (p   .01)  using  McNemar's  matched 
[lair  analysis. 

A  numh(;r  of  milk  sampJes  from  the  dairy,  wliich  sold  approximately 
3,000  gallons  of  raw  milk  per  week,  were  analyzed;  two  yielded  Salmonella 
typhimurium.   Rectal  swabs  from  all  animals  in  the  dairy,  as  well  as  samples 
of  feed,  forage,  water  and  swabs  from  equipment,  were  negative,  with  the 
exception  of  a  baby  goat  from  which  Salmonella  typhimurium  was  isolated, 
and  one  cow  from  which  Salmonella  Group  CI  (untyped)  was  recovered.   Two 
consecutive  stool  samples  from  all  dairy  personnel  were  negative  for 
Salmonella . 

The  baby  goat  arrived  at  the  dairy  shortly  before  the  outbreak  began, 
and  was  being  fed  raw  milk  from  the  dairy.   All  goats  from  the  herd  from 
which  the  kid  originated  were  tested  and  found  negative  for  Salmonella. 

A  group  of  13  children  and  3  adults  toured  the  dairy  July  2,  1980, 
and  eiiii  consumed  ajiout  2  oiuices  of  raw  milk  wliile  there.   A  number  of  the 
tour  members  petted  the  baby  goat,  which  was  later  found  to  be  positive. 

Stool  samples  or  rectal  swabs  were  ol->Lained  from  13  of  the  children 
and  one  adult  in  this  group.   Salmonella  (Jroup  B  were  recovered  from 
samples  submitted  by  the  adult  and  four  of  the  children,  all  of  whom  were 
asymptomatic,  and  from  one  child  who  became  an  outbreak-related  confirmed 
case. 

Fourteen  isolates,  including  those  from  the  goat,  the  milk  and  a 
number  of  patients  were  serotyped  by  CDC,  and  all  were  found  to  be 
Salmonella  typhimurium.   These  14  isolates,  plus  all  other  isolates  from 
other  confirmed  cases  v/ere  resistant  to  ampicillin,  carbenicillin,  chlor- 
amphenicol ,  kanamycin,  and  tetracycline. 

Two  confirmed  cases  being  treated  for  other  medical  reasons  with 
antibiotics  to  which  this  organism  was  resistant  developed  Salmonella 
gastroenteritis  sever.il  days  following  initiation  of  drug  therapy. 
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One  of  these  patients  reported  liav.inp,  liad  >!,,i;tio(,  nter  i  t  i^>  in  late  liine, 
following  raw  milk  consumption.   y\  second  episode  of  gastroenteritis, 
during  which  Salmonel  la  Croup  B  was  rtM-ovcred,  1<>  I  1  owed  in  late  July, 
several  days  after  drug  therapy  began.   No  raw  milk  had  lieen  consumed 
after  the  dune  illness. 

The  dairy  was  closed  following  isolation  of  Salmonella  from  milk, 
and  was  reopened  following  inspection  of  the  facility,  clinical  evaluatioi 
of  dairy  animals,  and  two  sets  of  negative  laboratory  results  from  rectal 
swabs  or  stool  samples  from  all  animals  and  dairy  personnel. 

Only  one  confirmed  case  reported  consumption  ot  raw  milk  from  the 
dairy  in  tlie  month  after  sales  resumed.  Daily  testing  of  the  milk  for 
30  days  after  reopening  yielded  no  Salmonella. 


Reported  by  W.  K.  DeCou,  R.S.;  Crystal  Day,  R.N.;  David  Feffer,  MPH, 
County  Health  Officer,  Missoula  County  Health  Department;  J.  Kelly,  M.S., 
infectious  Disease  Center,  Missoula;  G.  Mead,  I'h.D.,  Laboratory  Director, 
St.  Patrick's  Hospital,  Missoula;  L.  Colbo,  M.S.,  Clinical  Microbiology 
Supervisor;  B.  Desonia,  Field  Health  Officer;  M.  Skinner,  M.D.,  State 
lilpidemiologist ,  Montana  State  Department  of  Healtli  and  Environmental 
Sciences;  .1.  Glosser,  D.V.M.,  State  Veterinarian,  Montana  State 
Department  of  Livestock;  Field  Services  Division,  Bureau  of  F,pidemiology , 
CDC. 
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"> 


COMMUNICABLE  DISEASE  MODEL 

Evaluation  Plan 

Introduction 


Although  communicable  disease  used  to  be  the  major  cause  of  death  in  the 
United  States,  today  only  one  category  is  ranked  among  the  top  ten  causes 
of  death  (influenza/pneumonia) .   The  economic  impact  of  communicable  disease 
today  is  the  still  increasing  social  costs  of  morbidity  in  terms  of  quality 
of  life,  decreased  work  productivity  and  increased  health  care  costs.   For 
example,  indirect  costs  for  viral  hepatitis  (1970)  have  been  estimated  at: 


VIRAL  HEPATITIS 


Time  lost  from 
work  for  treatment 
and  convalescence 

Lost  earnings 
premature  death 

Total- 
all  sources 

$114.3  million 

$66.7  million 

$181  million 

Productivity 
Losses  Due  To 


Public  Health  Reports,  July-August  1976. 

Health  economists  have  estimated  the  costs  of  other  communicable  diseases  at: 

•  measles  -  average  annual  cost  of  $125  million 

(from  the  years  of  1963-1968) 

•  tuberculosis  -  $724  million  (in  1954) 

•  polio  -  $26  million  (in  1954)^° 

Nationally  there  has  been  a  downward  trend  in  the  incidence  of  infectious 
disease  morbidity  and  mortality.   Jumps  in  incidence  of  some  diseases  (noteably 
measles  and  rubella)  continue  to  appear  in  the  general  downward  trend.   It  has 
been  the  role  of  public  health,  since  surveillance  of  communicable  diseases  in 
the  U.S.  began  in  1878,  to  monitor  communicable  diseases  to  deal  quickly  and 
effectively  with  reported  outbreaks  and  to  reduce  morbidity  and  mortality. 

Montana's  incidence  of  reportable  diseases  (chart  next  page)  generally 
is  consistent  with  national  trends. 
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/.  TABLE  2        ,   ' 

Repijrted  Cases  of  Specified  Notifiable  Diseases 


CASES 


hepatitis  A 

measles 
tuberculosis 


1968   '69   "70   '71   "72   '73   '74   '75   '76   '77   '78 

[SouAce.:     "197S  Annual  R^poAt  o{^  Communicable.  VLi,Q,aA,<ii> 
Statz  HexiLth  VtpaAJbmnt,"  Apnll  )979,  Montana  State. 
Health  VepoAtrnznt. ) 

The  state  of  Montana  has  experienced  several  outbreaks  of  vaccine-preven- 
table diseases — measles  in  1973,  1974  1976-77  and  rubella  in  1973,  1974  and 
1976.   The  H.E.W. -snonsored   Immunization  Initiative  of  1977-79  is  seen  by 
many  public  health  officials  in  Montana  as  a  good  beginning  toward  solving 
the  problem  of  repeated  childhood  disease  outbreaks  and  toward  establishing  a 
permanent  system  to  deal  with  vaccine  preventable  disease  in  Montana. 

It  is  generally  agreed  that  the  role  of  public  health  in  dealing  with  the 
problem  of  communicable  disease  is  to: 

VKz\ie,nt  and  control  the  incldenze  and  ipn.ead  oi  commanicable  dliea^e^. 

Specifically,  public  health  programs  are  designed  to  minimize  the  incidence 
and/or  spread  of  communicable  diseases,  educate  the  public  and  health  profession- 
als, investigate  reported  cases,  reduce  the  medical  complications  of  communi- 
cable diseases,  and  operate  communicable  disease  programs  in  an  effective  and 
efficient  manner. 

Public  health  departments  in  Montana  have  long  been  interested  in  evaluating 
their  efforts.   Their  desire  for  qualitative  and  quantitative  data  on  which  to 
base  their  program  planning  and  to  allocate  resources  was  formalized  with  the 
approval  of  a  two-year  research  evaluation  grant  between  the  State  Department 
of  Environmental  Sciences  and  the  Missoula  City-County  Health  Department,  as 
contractor  for  the  project.   The  Missoula  Health  Department,  responsible  for 
developing  evaluation  models  for  eight  public  health  programs,  will  develop  and 
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test  evaluation  models  in  Missoula,  revise  them  as  necessary,  and  then  distri- 
bute "user  guides"  to  local  and  state  health  department  for  their  use. 

Literature  Search 

A  comprehensive  literature  search  was  conducted  to  review  works  in  the  area 
of  evaluation  of  communicable  disease  programs  in  the  public  health  sector.   As 
stated  in  the  Sexually  Transmitted  Disease  literature  search,  little  was  found  to 
be  of  use  in  direct  application.   A  brief  review  of  generally  relevant  work  follows: 


ToUma,   V. ,   B^yan  J. 
"The  Economic  Impact  oi 
VajloJL  Hzpatltli  In  the 
U.S." 


BaAk2A,  W.,  SagoAMA,   J. 
qX.   at.     "Toodboxnc 
^C6ea6e  SuAveAlZance" 


SchQiZ,   N.   "Comman^cabU 
Vli>zaA<i  Repofitlng" 


TlzdA,   R.   and  Vfiavda,  V. 
"V/Lopoitd  To££- FA.ee  Tele.- 
phone  Reponjting  o^ 
Uotiilable  Vl6e(uei>." 


Scha(iineA,  W.;  Scott  H. 
et.  at.     "Innovative 
Cormanicable  V-(J>eaAe 
RepofvtinQ . " 


Rev-Lewi  v-OloZ  hepatttU)  mofibidlty  and 
moAtatlty  data  to  estimate  the  economtc 
tmpact  ol  vXaoI  hepatLtU,  duAlng   1970. 
AAtccte  potn-ti  out  that  the  economic 
impact  0(5  the  dlieaie,  oveA  $650  million 
in  1970,   contAa!iti>  &haAply  Mith  >iei,ean.ch  on 
\}ih.aJi  hepatitU)  estimated  to  have  co^t  $7 
milZlon  in  1972.     Makes  an  aAgiment  (,oK 
hepatitis  irmanization. 

PeicAxbei  a  i>y6tem  MheAe  a  systematic 
{iOodbo^ne  disease  suAvellZance  system 
Mas  estabZished  in  Washington  State. 
The  author  demonst/iate  the  capacity  OjJ 
systematic  SLiAveltiance  to  recognize  and 
cont/Lol  ioodbon.ne  disease  in  a  given  a/iea. 
The  aAticle  also  shorn  the  e{,iects  o^ 
close  cooperation  among  government  agencies 
toward  detection  and  conAection  o;$  con- 
ditions leading  to  {jOodbofine  disease. 

Shorn  establishment  oi  a  pfiogfiam  ioK  better 
communication  between  physicians  and 
health  department.     A  24-hour  automatic 
phone  service  and  a  bi-monthty  newsletter 
to  physicians  resulted  in  a  1,000%  increase 
in  one  quarter  oi  1977 . 

Used  Survey  methodology  to  determine  the 
extent  of,  under- reporting .     A  method  0|{ 
increasing  disease  fieponting  was  established 
and  physicians  were  asked  to  report  communicable 
diseases  by  ctassi{,ication  --  emergency, 
serious  and  other  {collective  reporting). 

RepoKts  on  experimental  reporting  system 
using  40  paid  community  physician     con- 
sultants and  stressing  rapid  {^eedback  to 
all  area  physicians  o{i  results  Oj^  reporting. 
The  system  documented  the  idea  o^  innovation 
and  called  lor  {^urther  experimentation. 
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WajUlq,,  J.;  kxYilck,   U.  Vata  p^a^^ntzd  n.(u.niofic2A  the.  ilgnlilcancd. 

"The.  BendliZi,   F/iom  7  0       Ojf  meoA-Cei  and  b&m{i-iti,   oj^  pn.e.ventcuU.ve. 

Vea/u  o{,   Mea6£e6  Jmmuyu.-  rmaiuAeA.     EitunateA  a  iavlng6  o^   $J.3 

zcution  in  the  U.S."  bilLLon  {jAom  mea^teJi  immunization  and 

points  out  the  advantage  o(^  adminii,tAatou 
ui>ing  thij,  type.  o{)  data  in  decU ion- making 
and  6pe.ndA.ng  publi.c  money. 

There  does,  then,  appear  to  be  a  scarcity  of  evaluation  data  as  evidenced  by 

the  communicable  disease  literature  search  (for  complete  bibliography,  see 

Appendix  A) .   Contact  was  made  with  experts  in  the  field  of  communicable  disease 

surveillance  and  comments  will  be  solicited  from  these  people  throughout  the  term 

of  the  communicable  disease  model  development  and  testing. 

•  Dr.  Martin  Skiiiner,  Chief,  Preventive  Health  Services  Bureau, 
Montana  Department  of  Health  and  Environmental  Sciences,  Helena, 
Montana . 

•  Rick  Crankshaw,  Coordinator,  Immunization  Program,  Montana 
Department  of  Health  and  Environmental  Sciences,  Helena,  Montana. 

•  Bruce  DeSonia,  Field  Epidemiologist,  Montana  Department  of 
Health  and  Environmental  Sciences,  Missoula,  Montana. 

•  Dr.  Richard  Hopkins,  Denver  Health  Department,  Denver, 
Colorado. 

•  Dr.  Stephen  Thacker,  Center  for  Disease  Control,  others, 
Atlanta,  Georgia. 

•  Dr.  Fuchashema,  Utah  State  Health  Department,  Salt  Lake  City, 
Utah. 

Local  Health  Department  Administrators 

Don  Pizzini,  Health  Officer  and  Cherry  Travis,  Nursing  Director,  City-County 
Health  Department,  Great  Falls,  Montana. 

Bob  Johnson,  Health  Officer  and  Shirley  McGuire,  Nursing  Director,  Lewis 
and  Clark  Health  Department,  Helena,  Montana. 

David  Feffer,  Health  Officer,  Crystal  Day,  Nursing  Director,  Diana  Anderson, 
RN,  Mary  Taylor,  RN,  Missoula  City-County  Health  Department,  Missoula,  Montana. 

Bill  Burke,  Health  Officer,  Silver  Bow  Health  Department,  Butte,  Montana. 

George  Sheckleton,  Health  Officer,  Jan  Treml,  Nursing  Director,  Yellowstone 
Health  Department,  Billings,  Montana. 


e.k 
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Edward  King,  Health  Officer,  Jackie  Stonnel,  Nursing  Director,  Gallatin 
)         City-County  Health  Department,  Bozeman,  Montana. 

Bruce  Mclntyre,  Health  Officer,  Audrey  Gonzales,  Nursing  Director,  Flat- 
head City-County  Health  Department,  Kalispell,  Montana. 

Close  communication  will  be  maintained  with  both  local  and  state  health 
departments  as  well  as  with  other  communicable  disease  experts.  Continued 
sources  of  information  will  be  sought  throughout  the  project. 

MeXhodi,  oj  VfioczdvJiz 

Because  of  the  danger  of  the  uncontrolled  spread  of  communicable  diseases 
and  the  resultant  costs  to  society,  public  health  has  historically  given  cases 
of  diseases  like  tuberculosis,  hepatitis,  measles,  and  salmonella  a  high 
priority  in  terms  of  expending  resources  and  staff  time. 

Communicable  disease  incidence  is  highly  variable,  creating  problems  for 
public  health  agencies  as  they  try  to  plan  how  many  personnel  and  the  level 
of  resources  needed  from  year  to  year  in  order  to  adequately  control  and  pre- 
vent communicable  diseases.   When  communicable  disease  incidence  is  plotted 
)       (see  Table  2,  page  2)  it  becomes  evident  that  any  attempts  to  predict  the 
next  outbreak  are  largely  useless.   Public  health  has  historically  placed 
a  high  priority  in  dealing  quickly  with  communicable  disease  outbreaks  to 
the  exclusion  of  other  programs  and  activities.   When  an  outbreak  is  reported 
and  confirmed,  all  other  public  health  activity  is  relegated  to  second  place 
while  the  immediate  health  danger  of  the  outbreak  is  dealt  with. 

Further  compounding  the  problem  of  the  erratic  nature  of  disease  incidence 
is  reporting.   With  many  diseases,  public  health's  ability  to  effectively 
control  a  problem  is  significantly  affected  by  receiving  early  warning  of  an 
outbreak.   Unless  public  health  knows  the  extent  of  a  disease  problem  it  is 
also  impossible  to  accurately  plan  and  allocate  resources.   The  Center  for 
Disease  Control,  in  a  1971  survey,  estimated  reporting  rates  for  six  communi- 
cable diseases  at: 
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Reporting  Rates  for  Selected  Communicable  Diseases 
Washington,  DC  January- June  1971 


CASE/TOTAL 

PERCENT 

Viral  Hepatitis 

31/282 

11 

H.  Influenzae  Meningitis 

7/22 

32 

Salmonellosis 

11/26 

42 

Meningococcal  Meningitis 

3/6 

50 

Shigellosis 

21/34 

62 

Tuberculosis 

127/200 

63 

Total 

200/570 

35 

American  Journal  of  Epidemiology,  "The  Reporting  of  Communicable 
Diseases,"  1977. 

This  research  appropriately  illustrates  the  current  issue  of  communicable 
disease  reporting  -  "What  is  the  true  extent  of  reportable  diseases?" 

There  are  currently  55  diseases  deemed  reportable  in  Montana.   Because 
evaluation  of  total  communicable  disease  surveillance  programs  of  public  health 
is  beyond  the  scope  of  this  evaluation  project,  five  communicable  diseases 
were  selected  by  evaluation  model  users  and  other  experts. 

•  Measles  •  Giardia 

•  Tuberculosis  •  Hepatitis  A  (Infectious) 

•  Salmonellosis 

It  was  widely  agreed  that  these  selected  diseases  are  representative  of  the 
wide  range  of  communicable  diseases  in  epidemiology  and  incidence.   For  purposes 
of  this  project,  these  five  diseases  will  serve  as  indicators  in  general  for 
communicable  disease. 

The  Communicable  Disease  Evaluation  Model,  which  will  result  from  develop- 
ment and  testing  of  the  evaluation  plan's  output,  will  be  easily  applied  to 
other  communicable  diseases  as  desired. 

Estimated  program  objectives  will  be  used  as  research  objectives.   Meeting 
the  objectives  then  becomes  a  measure  of  the  program's  effectiveness  and 
efficiency.   In  other  words,  is  the  program  meeting  the  over-riding  goal  of 
public  health  which  is  to: 

PfL^ve.yit  and  cowtAol  thu  lyicidzncQ.  and  i>pfi(iad  o^^  communicable   cicieoie. 


According  to  Regulation  40,  btate  Board  of  Health. 
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Objectives  by  Fiscal  Year 

(Missoula  City-County  Health  Department) 

1.  To  achieve  and  maintain  a  general  childhood- immunization  level  of 
90  percent. 

2.  To  establish  and  maintain  communicable  disease  staff  protocols  to 
insure  consistent  and  accurate  communicable  disease  surveillance, 
response  and  prevention. 

3.  To  maintain  a  reporting  system  whereby  cases  of  specific  communi- 
cable diseases  are  reported  to  the  health  department  within  established 
time  limits  from  diagnosis/confirmation. 

4.  To  establish  and  maintain  a  data  system  detailing  health  department 
costs  of  providing  communicable  disease  surveillance  and  prevention. 

Communicable  Disease  Evaluation  -  Description 

The  communicable  disease  evaluation  plan  will  be  designed  to  produce  data  on 
the  five  diseases  mentioned  previously  -  measles,  hepatitis  A,  salmonellosis, 
giardia,  and  tuberculosis.   The  data  systems  will  be  designed  to  be  easily 
replicable  for  use  on  other  diseases,  as  well. 

The  communicable  disease  evaluation  is  designed  to  be  used  in: 

(1)  providing  a  base  for  planning  and  administrative  decision-making, 

(2)  evaluating  communicable  disease  programs  for  effectiveness  and  efficiency. 
Evaluation  descriptions  for  each  of  the  seven  research  objectives  will  follow 

the  same  format:  (1)  rationale  for  the  established  objective  will  be  discussed, 
(2)  methodology  will  be  detailed  and  explained,  and  (3)  use  of  data  will  be 
given . 
Objective  1.   To  achieve  and  maintain  a  general  childhood- immunization  level 

of  90  percent. 
Rationale  -  The  statewide  Immunization  Initiative  established  a  90  percent 
immunization  goal.   The  concerted  effort  to  reach  that  goal  resulted  in  approxi- 
mately a  percent  statewide  immunization  level  (86%  in  Missoula  County) .  Long- 
range  goals  set  by  the  HEW  call  for  institutionalizing  the  Immunization  Initiative   ^d 
so  that  its  gains  are  not  lost.   In  addition,  the  recently-enacted  school  entry  ^    n  "Q^' 
and  measles  quarantine  laws  should  help  to  uphold  established  immunization  levels. 

Establishing  a  90  percent  objective  sets  a  measurable  target  so  that  meeting 
(or  not  meeting)  the  objective  then  becomes  a  gauge  of  success.   The  levels 
to  be  measured  will  fit  the  State  Health  Department's  minimum  requirements 
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(see  Appendix  B)  for  school  children  for  polio,  DPT,  measles  and  rubella. 

Methodology  -   a  "two- Year-old  immunization  Survey",  conducted  each  year  by 
the  State  Health  Department  to  track  immunization  levels  of  two  to  two  and 
one-half  year  old  children,  is  considered  to  reflect  preschool  immunization 
levels. 

TWO  YEAR  IMMUNIZATION  SURVEY 
(Montana) 


1974^ 

1975^ 

1976^ 

1977"^ 

1978^ 

Polio  (3 

+  doses) 

70% 

73% 

78% 

88% 

88% 

DPT    (3 

+  doses) 

78% 

83% 

86% 

94% 

94% 

Measles 

81% 

80% 

83% 

92% 

90% 

Rubella 

79% 

75% 

78% 

90% 

89% 

Born  In: 

-'-January  -  December  1972 

January  -  June  1973 

■^January  -  June  1974 


_ January  -  June  1975 
'January  -  June  1976 


This  yearly  figure  can  be  easily  used  to  compare  trends  from  year  to  year. 

In  addition,  the  State  Health  Department  will  receive  reports  from  schools 
(grades  K  -  12)  in  compliance  with  the  new  law  requiring  immunizations  for 
school  entry.   The  results  will  be  available  yearly  and  can  be  used  in  tandem 
with  the  "Two-Year-old  Immunization  Survey"  to  measure  attainment  of  the 
objective. 

Should  immunization  levels  fall  below  90  percent,  the  health  department  then 
will  have  information  to  be  able  to  take  steps  to  bring  levels  up  thru  use  of 
increased  public  relations,  special  immunization  clinics  and/or  establishing 
a  county-wide  immunization  task  force. 

Use  of  Data  -  since  communicable  disease  takes  a  good  deal  of  public  health 
resources,  it  is  felt  that  a  long-term  measure  is  necessary  in  order  to  track 
effectiveness  of  control  efforts.   The  two  measures  described  are  currently 
available  and  easily  compiled,  although  attention  must  be  given  to  any  changes 
in  methodology  by  the  State.  Should  the  immunization  level  show  a  consistent 
falling  off,  then  administrators  will  have  the  opportunity  to  plan  remedial 
measures  well  in  advance. 


Yv9' 


,\vO-^ 


^0.^^ 
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Objective  2.  to  establish  and  maintain  communicable  disease  staff  protocols  to 
insure  consistent  and  accurate  communicable  disease  surveillance 
response,  and  prevention. 
Rationale  -   The  terms  "consistent"  and  "accurate"  for  the  purposes  of  this 
plan  mean  that  each  patient  who  is  followed  receives  the  same  high  quality  of 
care.   In  other  words,  every  patient  who  is  in  contact  with  the  communicable 
disease  program  will  receive  quality  care  equal  to  care  given  all  other  patients 
and  every  communicable  disease  outbreak  will  receive  equal  (quality)  investigation. 

A   formal  communicable  disease  protocol  can  be  used  not  only  in  day-to-day 
contacts,  but  also  as  a  training  tool.   As  noted  early  in  this  Evaluation  Plan, 
five  communicable  diseases  will  be  covered  by  protocol  -  measles,  hepatitis  A, 
salmonellosis,   giardia,  and  tiiberculosis  . 

Methodology  -  General  communicable  disease  protocols  will  be  drawn  up  for  each 
of  the  five  diseases  covered.   Each  disease  will  be  treated  differently,  depend- 
ing on  its  epidemiology  and  circumstances,  and  will  include  which  staff  member  is 
responsible ,  what  procedures  are  to  be  followed  and  how  evaluation  records  are 
to  be  kept. 

For  each  major  (five  cases  or  more)  outbreak,  a  separate  file  folder  will  be 
maintained  and  all  pertinent  data  will  be  kept  in  that  file.   A  formal  quality 
review,  used  on  a  quarterly  basis  to  evaluate  speed,  accuracy,  effectiveness 
and  outcome  of  department  response,  will  be  conducted  by  a  committee  of  nurses 
and  administrators.   A  short  written  report  will  follow  committee  action  to  be 
presented  to  nursing  administrators. 

Cost  data  will  be  designed  to  give  program  managers  costs  per  outbreak  thru 
institution  of  the  "outbreak  folder"   which  contains  all  pertinent  data  on  a 
disease  as  well  as  a  time  record  so  that  personnel  time  and  other  costs  may  be 
documented. 

Use  of  Data  -  use  of  formalized  procedures  will  insure  consistent  processing 
of  patients,  outbreaks  and  investigative  work.   The  quality  review  of  selected 
cases/outbreaks  will  insure  department  communication  and  give  managers  a  way 
to  keep  track  of  disease  procedures  and  outcomes  of  public  health  intervention. 
Cost  data  will  allow  administrators  to  better  plan  resource  allocation  and  to 
continually  track  current  expenditures  of  staff  time. 
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Objective  3.   To  maintain  a  reporting  system  whereby  cases  of  specific 

communicable  disease  are  reported  to  the  health  department  within 
established  time  limits  from  diagnosis/confirmation. 
Rational e  -  Not  knowing  the  extent  of  the  communicable  disease  problem  has 
resulted  in  public  health  departments  not  knowing  whether  they  have  made  an 
impact  and  not  being  able  to  allocate  resources  based  on  the  extent  of  disease 
incidence.   In  addition,  a  study  by  the  National  Opinion  Research  Center  (1966) 
showed  that  physicians  did  not  notify  the  health  department  of  disease  inci- 
dence because  significant  numbers  of  physicians  were  unaware  of  the  legal  re- 
quirements for  reporting  (34  percent  were  unaware  of  reporting  requirements 
for  measles,  for  example) .   Physicians  were  also  concerned  about  confidentiality 
and  had  a  feeling  that  their  reporting  of  some  diseases  was  useless. 

Another  study  (Cleere,  R.  L. ,  et_  al .  1976)  showed  that  completeness  of 
reporting  was  directly  related  to  the  confidence  expressed  by  physicians  in 
their  health  departments.   This  finding  was  cited  by  Schaffner,  Scott  and 
others  in  their  work  in  exploring  the  effects  of  improving  relationships 
between  doctors  and  health  departments. 

Objective  three  was  chosen  to  be  conducted  jointly  with  the  sexually 
transmitted  disease  evaluation  plan's  Objective  5  ("To  maintain  a  reporting 
system  whereby  cases  of  gonorrhea  are  reported  to  the  health  department  within 
48  hours  of  confirmation.")   This  way,  a  comprehensive  reporting  methodology 
can  be  conducted. 

Methodology  -  Because  of  lack  of  success  with  passive  reporting  systems,  three 
variations  of  an  active  system  will  be  tested  for  effectiveness.   It  is  felt 
that  passive  systems,  or  waiting  for  physicians  and  labs  to  report  on  their 
own,  have  compounded  the  puzzle  of  not  knowing  the  true  scope  of  communicable 
disease  incidence.   Active  reporting,  or  actively  contacting  the  medical 
community,  is  seen  as  a  far  better  way  to  maintain  a  grasp  of  true  disease 
incidence. 

There  are  three  options  that  will  be  tested  as  to  their  effectiveness.   The   ,  -^ 
first  step  for  all  three  will  be  to  interview  several  physicians,  labs  and     "^  . 
hospital  infectious  disease  personnel  about  reporting  to  get  their  input.       s 
Then  all  reporting  sources  will  be  divided  into  four  groups  for  experimental    la  to 
purposes. 
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The  reporting  research  will  be  directed  toward  physicians '  receptionists/ 
nurses  who  would  be  responsible  for  the  actual  reporting.   The  argument  has 
been  made  that  physicians  are  much  too  busy  to  stop  and  call  in  reports,  but 
their  staff,  who  file  away  patient  records,  would  be  a  more  logical  reporting 
participant. 

Group  I   -  Physician  receptionist  will  be  called  by  health 
department  communicable  disease  reporter  each 
Friday  afternoon  to  ask  for  reportable  diseases. 
A  "Disease  Incidence  Form"  will  be  drawn 
up  for  health  department  personnel  use. 
Group  II  -  Physician  receptionist  will  receive  a  "Disease       -^ 
Incidence  Form"  from  health  department  communicable   ^ 
disease  reporter  by  Friday  of  each  week  with        Oj 
instructions  to  mail  it  back  by  Tuesday.  ^ 

Group  III  -  Physician  receptionist  will  receive  a  pad  of 

"Disease  Incidence  Forms"  to  keep  on  hand.  ^-^ 

By  Friday,  they  will  receive  a  post-card  Ci 

reminder  from  the  health  department  to  fill  S 

out  the  form  and  return  it  by  Tuesday. 
Group  IV  -  Will  serve  as  control  group.   No  active  or 
additional  contact  will  be  made. 
There  will  be  different  levels  of  staff  time  and  costs  used  for  each  of  the 
three  methodologies.   A  cost  analysis  will  be  drawn  up  for  each,  so  that  the 
final  decision  of  which  method  is  most  effective  will  be  also  cost-effective. 
Disease  incidence  will  be  tabulated  and  reported  to  physicians,  labs  and  the 
community. 

Use  of  Data  -  An  accurate  and  consistent  reporting  system  will  yield  current 
disease  outbreak  information  to  not  only  public  health,  but  also  to  area 
physicians.   This  will  meet  legal  requirements  as  well  as  give  administrators 
an  accurate  measure  of  communicable  disease  incidence  in  the  county  so  that 
they  may  plan  resource  allocation  and  staffing  patterns. 
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Objective  4.  to  establish  and  maintain  a  data  system  detailing  health  department 
costs  of  providing  communicable  disease  surveillance  and  prevention. 
Rationale  -  The  most  frequently  mentioned  data  need  is  cost.   Administrators 
have  placed  a  high  priority  on  receiving  carefully  formulated  cost  figures  on 
what  it  costs  the  health  department  to  provide  immunizations,  prevention  and 
follow-up  services  to  the  community. 

Methodology  -  a  data  system  is  defined  for  purposes  of  this  project  as  a  means 
of  setting  up  clearly  defined  measurements  of  costs  in  such  a  way  that  all 
forms  and  methodologies  are  easily  replicated  from  year  to  year  in  a  time  series. 

Evaluation  of  communicable  disease  control  activities  will  be  split  into  two 
parts:   (1)  health  department  cost,  and  (2)  cost-benefit  data  for  each  of  the  five 
selected  diseases. 

Full  definitions  of  services  and  methodology  will  be  included.   For  example: 


Per  Immunization 
((total  personnel 

MEASLES  COST  WORKSHEET 
(clinic) 

Cost 

time  +  fringe)  x  number  of  immunizations  given) 

+           X 

X  overhead 

+  supplies/equipment  = 

Subtotal 

+  other 

Total  Cost 

€^ 


^^ 


In  addition,  national  figures  on  cost/benefit  ratios  will  be  provided  in  order  i  "^ 

'^  . 
to  give  Montana  health  departments  an  idea  of  what  kinds  of  benefits  they  are     g^  g^ 

receiving  from  their  expenditures. 

Use  of  Data  -  current  and  accurate  cost  data  will  always  be  needed  by  admini- 
strators who  are  faced  with  discrepencies  between  the  demand  for  piiblic  health 
activities  and  quantities  of  money  and  staff  to  conduct  those  activities. 
Knowing  the  cost  differences  of  different  activities  and  the  levels  of  time 
and  dollars  being  used  is  a  powerful  tool  for  resource  allocation. 


fi 
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ImpticatioM  oj  Commayilcabl2.  VAj^za^d  ModaZ 

As  stated  earlier,  the  Communicable  Disease  Model  will  be  generalizable  to 
fit  other  health  department  needs  and  other  communicable  diseases.   The  method- 
ologies described  in  this  evaluation  plan  are  concise  and  designed  to  result 
in  immediately  useful  data,  whether  users  refer  to  Missoula  results  or  construct 
their  own  cost  data,  reporting  system  or  procedures. 

Publication  of  the  methodology  and  results  of  the  communicable  disease 
evaluation  model  must  be  considered.   The  literature  search  turned  up  little 
of  direct  use,  indicating  a  dearth  of  information  on  measuring  the  effective- 
ness and  efficiency  of  public  health  programs  nation-wide. 

Janice  S.  Hand 
January,  1980 


6.13 


Appendix  A 


Bibliography 

1.  Amadio,  J.B.,  Mueller,  J.,  Casey,  R.  "Measuring  the  Benefit  of  Public  Health 

Services,"  Public  Health  Currents  (Ross  Times aver),  pp.  15-18,  August  1978. 

2.  Barker,  W.H.,  Sagerser,  J.C,  Hall,  C.V.H.,  Anderson,  H.W.,  Francis,  B.J,  "Food- 

bome  Disease  Surveillance,"  American  Journal  of  Public  Health,  6ki9):Q5k- 
859,  September,  197^. 

3.  Bean,  J. A.,  Burmelster,  L.F.,  Paule,  C.L.,  Isacson,  P.  "A  Comparison  of  National 

Infection  and  Immunization  Estimates  for  Measles  and  Rubella,"  American 
Journal  of  Public  Health,  68(12) :  121^1-1216,  December,  1978. 

^.  Bootman,  J.L.,  Rowland,  C,  Wertheimer,  A.I.  "Cost-Benefit  Analysis:  A  Research 
Tool  for  Evaluating  Innovative  Health  Programs,"  Evaluation  and  the  Health 
Professions ,  2(2) : 129-15^,  June  1979, 

5.  Brunell,  P. A.  "Measles  immunization:  12  or  15  months?"  Pediatrics,  62(6):1038- 

10^1  (ed),  December,  1978. 

6.  Communicable  Disease  Control  Conference,  Houston,  Texas,  March  12-17,  1972. 

7.  Crystal,  R.A.,  and  Brewster,  A.W.  "Cost  Benefit  and  Cost  Effectiveness  Analyses 

in  the  Health  Field:  An  Introduction,"  Inquiry,  3(^):3-13,  December,  I966, 

0.  Denes,  A.E.,  Smith,  J.L.,  Hindman,  S.H.,  Flelssner,  M.L.,  Judelsohn,  R. ,  Englender, 
S.J.,  Tilson,  H.,  Maynard,  J.E.  "Foodborne  Hepatitis  A  Infection:  A  Report 
of  Two  Urban  Restaurant-Associated  Outbreaks,"  American  Journal  of  Epidemiology, 
105(2) :156-l62,  1977. 

9.  Dunlop,  D.W.  "Benefit-Cost  Analysis:  A  Review  of  its  Applicability  in  Policy 
Analysis  for  Delivering  Health  Services,"  Social  Science  and  Medicine, 
Volume  9,  pp.  133-139,  (1975). 

10.  Farber,  M.E.,  and  Flnkelsteln,  S.N,  "A  Cost-Benefit  Analysis  of  a  Mandatory 

Premarital  Rubella-Antibody  Screening  Program,"  The  New  England  Journal 
of  Medicine,  300(15) : 856-859,  April  12,  1979. 

11.  Felngold,  A.O.  "Cost  Effectiveness  of  Screening  for  Tuberculosis  in  a  General 

Medical  Clinic,  Public  Health  Reports,  90(6) :5^^-5^7,  November-December,  1975. 

12.  Grimm,  R.H.,  Shimoni,  K. ,  Harlan,  W.R.,  Estes,  E.H.  "Evaluation  of  Patient-Care 

Protocol  Use  by  Various  Providers,"  The  New  England  Journal  of  Medicine, 
292(10): 507-511,  March  6,  1975. 

13.  Hooper,  R.R.,  Juels,  C.W.,  Routenberg,  J. A.,  Harrison,  W.O.,  Kilpatrlck,  M.E., 

Kendra,  S.J.,  Dienstag,  J.L.  "An  Outbreak  of  Type  A  Viral  Hepatitis  at  the 
Naval  Training  Center,  San  Diego:  Epidemiologic  Evaluation,"  American  Journal 
of  Epidemiology,  105(2) :  1^18-155,  1977. 

6.14 


C 


Bibliography- 
Page  2 


1'+.  Krugman,  S.  "Present  status  of  measles  and  rubella  immunization  in  the  United 
i      States:  A  medical  progress  report,"  The  Journal  of  Pediatrics,  78(l):l-l6, 
'      January,  1971. 

15.  Levy,  B.S.,  Mature,  J.,  Washburn,  J.W.  "Intensive  Hepatitis  Surveillance  in 

Minnesota:  Methods  and  Results,"  American  Journal  of  Epidemiology, 
105(2)  :127-13't,  1977. 

16.  Linnemann,  C.C.,  Rotte,  T.C.,  Schiff,  G.M.,  Youtsey,  J.L.  "A  Seroepidemiologic 

Study  of  a  Measles  Epidemic  in  a  Highly  Immunized  Population, "  American 
Journal  of  Epidemiology,  95(3) : 238-246,  1972. 

17.  Marier,  R.  "The  Reporting  of  Communicable  Diseases,"  American  Journal  of  Epidemiology, 

105(6) :587-590,  (1977). 

18.  Marks,  J.S.,  Halpin,  T.J.,  Orenstein,  W.A.  "Measles  Vaccine  Efficacy  in  Children 

Previously  Vaccinated  at  12  Months  of  Age,"  Pediatrics,  62(6) :955-960, 
December,  1978. 

19.  Meyer,  W.T.  "Epidemic  giardiasis,  a  continued  elusive  entity,"  Rocky  Mountain 

Medical  Journal,  pp.  kS-k9,   October,  1973. 

20.  Montana  Year  of  the  Child,  "Why  lYC  -  Children  and  Youth  Deserve  Better''  (Community 

News),  1979. 

21.  Mushkin,  S.J.  "Health  as  an  Investment,"  Journal  of  Political  Economy,  70:129-157 

(supplement),  October,  1962. 

22.  Nalimias,  A.J.,  and  McCroan,  J.E.  "A  Community  Surveillance  System  of  Infectious 

Diseases  in  the  Greater  Atlanta  Area, "  American  Journal  of  Public  Health , 
56(3):no8-Ul4,  March,  I966. 

23.  Office  of  Planning  and  Program  Analysis,  Department  of  Health,  Health  and  Welfare 

Agency,  State  of  California,  Benefits  and  Costs  of  the  Family  Planning 
Program,  December  1,   1977. 

2k.   Office  of  Planning  and  Program  Analysis,  California  Department  of  Health  Services, 
"An  Ounce  Of  Prevention  Is  Worth  It:  Benefits  And  Costs  Of  Family  Planning," 
The  Annual  Meeting  of  the  American  Public  Health  Association,  October  I8, 
1978. 

25.  Peirce,  T.H.,  York,  G.K.,  Parsons,  G.H. ,  Spannagel,  V.,  Lillington,  G.A. ,  Cross, 

C.E.  "A  Combined  Health  Department-Medical  School  Rural  Outpatient  Tuber- 
culosis Program,"  American  Journal  of  Public  Health,  67(3) :257-259,  March, 
1977. 

26.  Prest,  A.R.,  and  Turvey,  R.  "Cost-Benefit  Analysis:  A  Survey,"  The  Economic 

Journal,  pp.  683-735,  December,  1965. 

27.  Preventive  Health  Services  Bureau,  Montana  Department  of  Health  and  Environmental 

Sciences,  "I978  Annual  Report  of  Communicable  Diseases,"  April  1979. 

\  Rabelow,  C,  Calhoun,  F.,  Schaffner,  F.  (Classification  of  Hepatitis),  American 
Public  Health  Association  Conference,  New  York  City,  November,  1979. 

6.15 


Bibliography 
Page  3 


29.  Riehl,  E.D.,  Bereznicki,  G. ,  Rogers,  G. ,  Reza,  R. ,  Eagan,  J.  "An  Integrated 

Approach  to  Tuberculosis  Care  in  the  Gominonwealth  of  Pennsylvania,"  American 
Journal  of  Public  Health,  67(2)  :l62-l6it,  February,  1977. 

30.  Schaffner,  W, ,  Scott,  H.D.,  Rosenstein,  B.J.,  Byrne,  E.B.  "Innovative  Communicable 

Disease  Reporting,"  HSMHA  Health  Reports,  86(5) :^31-H36,  May,  1971. 

31.  Scheffler,  R.M.  "A  Methodological  Framework  for  Cost-Benefit  Analysis  in  Health," 

(source  unknown). 

32.  Schell,  N.B.  "Communicable  Disease  Reporting,"  New  York  State  Journal  of  Medicine, 

p.  1800,  September,  1977. 

33.  Schluederberg,  A.,  Lamm,  S.H.,  Landrigan,  P.J.,  Black,  F.L.  "Measles  Immunity 

in  Children  Vaccinated  Before  One  Year  of  Age,"  American  Journal  of 
Epidemiology,  97(6) : ^02-1+09,  1973. 

3k.   Schoenbaum,  S.C,  Hyde,  J.N.,  Bartoshesky,  L. ,  Crampton,  K.  "Benefit-Cost  Analysis 
of  Rubella  Vaccination  Policy,"  The  New  England  Journal  of  Medicine, 
29^(6): 306-310,  February  5,  197^^ 

35.  Schweitzer,  S.O.  "Cost  Effectiveness  of  Early  Detection  of  Disease,"  Health 

Services  Research,  pp.  22-32,  Srping,  197^. 

36.  Shelton,  J.D.,  Jacobson,  J.E.,  Orenstein,  W.A.,  Schulz,  K.F.,  Donnell,  H.D. 

"Measles  Vaccine  Efficacy:  Influence  of  Age  at  Vaccination  vs.  Duration 
of  Time  Since  Vaccination,"  Pediatrics,  62(6) :96l-96^,  December,  1978. 

37.  Steele,  J.H.  "Salmonellosis:  a  growing  threat,"  Consultant,  pp.  I66-I68,  March, 

1973. 

38.  Tager,  I.B,,  Speizer,  F.E.  "Surveillance  Techniques  for  Respiratory  Illness," 

Archives  of  Environmental  Health,  pp.  29-32,  January-February,  1976. 

39.  Tizes,  R.,  and  Pravda,  D.  "Proposed  Toll-Free  Telephone  Reporting  of  Notifiable 

Diseases,"  Health  Services  Reports,  87(7) :633-637,  August-September,  1972. 

^0.  Tolsma,  D.D.,  and  Bryan,  J. A.  "The  Economic  Impact  of  Viral  Hepatitis  in  the 
United  States,"  Public  Health  Reports,  91(^) :3^9-353,  July-August,  1976. 

^1.  United  States  Department  of  Health,  Education,  and  Welfare,  Public  Health  Service, 
Center  for  Disease  Control.  Immunization  Abstracts  and  Bibliography, 
Vol.  1,  April,  1979.  HEW  Publication  No.  (CDC)  79-8372. 

k2.   United  States  Department  of  Health,  Education,  and  Welfare.  "Immunization," 
pp.  25-29,  (source  unknown). 

H3.  United  States  Department  of  Health,  Education,  and  Welfare,  Public  Health  Service, 
Center  for  Disease  Control.  Measles  Surveillance,  Report  No.  10,  July,  1977. 

kk .   United  States  Department  of  Health,  Education,  and  Welfare,  Public  Health  Service, 
Center  for  Disease  Control.  Reported  Morbidity  and  Mortality  in  the  United 
States.  Morbidity  and  Mortality  Weekly  Report,  Annual  Summary  1977,  26(53) :2-i 
September,  1978. 

6.16 


Bibliography 
Page  k 


''5.  United  States  Department  of  Health,  Education,  and  Welfare,  Public  Health  Service, 
'       Center  for  Disease  Control.  United  States  Immunization  Survey:  1976, 
pp.  25-37,  November,  1977-  HEW  Publication  No.  (CDC)  78-8221. 

^♦6.  United  States  Department  of  Health,  Education,  and  Welfare,  Public  Health  Service, 
Center  for  Disease  Control.  United  States  Immunization  Survey :  1977, 
pp.  25-35,  October,  1978.  HEW  Publication  No.  (CDC)  79-8221. 

^7.  United  States  Department  of  Health,  Education,  and  Welfare,  Public  Health  Service, 
Center  for  Disease  Control.  Summary  of  Immunization  Status  for  Polio, 
DTP,  Measles,  Rubella,  and  Mumps-United  States,  1978.  Preliminary  Report : 
U.S.  Immunization  Survey,  1978. 

'^8.  United  States  Department  of  Health,  Education,  and  Welfare,  Center  for  Disease 
Control,  Bureau  of  Training,  Program  Planning  for  Disease  Control  Programs , 
February,  1976. 

^9.  United  States  Department  of  Health,  Education,  and  Welfare,  Public  Health  Service, 
Center  for  Disease  Control.  Surveillance  and  Control  of  Infectious  Diseases: 
Preventing  Disease/Promoting  Health:  Ob j ectives  for  the  Nation.  To^raft  working 
paper) . 

50.  United  States  Department  of  Health,  Education,  and  Welfare.  "Surveillance  and 
Control  of  Infectious  Diseases,"  pp.  70-76,  (source  unknown). 

'^l.  Witte,  J.J.  (ed).  "Preventable  Childhood  Diseases  the  Threat  to  Public  Health," 
*      Public  Health  Currents  (Ross  Timesaver),  13{h):l-k,   October,  1975. 

52.  Witte,  J.J.  "Recent  Advances  in  Public  Health  Immiuiization,"  American  Journal  of 

Public  Health,  6^(10) :939-9^^,  October,  197^. 

53.  Witte,  J.J.,  and  Axnick,  N.W.  "The  Benefits  from  10  Years  of  Measles  Immunization 

in  the  United  States,"  Public  Health  Reports,  90(3) : 205-207,  May-June,  1975. 

5^.  Wright,  R.A.,  Spencer,  H.C.,  Brodsky,  R.E.,  Vernon,  T.M.  "Giardiasis  in  Colorado: 
An  Epidemiologic  Study,"  American  Journal  of  Epidemiology,  105(^) : 330-336, 
1977. 

55.  Yeager,  A.S.,  Davis,  J.H.,  Ross,  L.A.,  Harvey,  B.  "Measles  Immunization:  Successes 

and  Failures,"  Journal  of  the  American  Medical  Association,  237(^) : 3^+7-351, 
January  2k,   1977. 

56.  United  States  Department  of  Health,  Education,  and  Welfare,  Public  Health  Service, 

National  Institute  of  Allergy  and  Infectious  Diseases.  Tuberculosis .  HEW 
Publication  No.  (NIH)  7^-^13. 


6.17 


Appendix  B 


3 

3   I 

3  3 


r+  O 
O 


^      -b  -S 

3     n>  3- 

-s 
— '         a- 


O    Q. 

— '  CU 


— '      00      CTl 


OO       U>      CO       CO 


(T>       fD       fD       fD 

D)     CU     Qj     ai 


fD     (D     (T>     ro 

(/)         (/I         CO         (/> 


fD       fD       (T> 


-1.      -I.      o, 


Q 


6.11 


"7^ 

"~ 

1 

JD 

C\J 

(XJ 

OJ 

C\J 

CVJ 

CO 

ro 

O 

■o 

-t-J 

cu 

Q)           ■)-> 

0  XI  0 

0 

in 

o 

O    OJ 

U  -O  M- 

0  X)  •-- 

C    4-> 

re   s- 

4-> 

3 

j=  :jz 

c  cu  It- 

C    QJ    C 

s-  re 

+-> 

QJ 

00   00 

-a 

o 

re  4->  re 

re  -M  re 

Ql           4-" 

re 

C    Q- 

x;  0 

c 

to     OJ 

S-     O   4-> 

S-    0    00 

>^ 

XI  ^   s- 

4-> 

0 

0    Q-     • 

OJ 

o 

+J 

3    3    to 

3   3 

^  re  0 

-C             i- 

s- 

o 

E    re 

l/l  XI 

00  XI  X) 

4-J 

0    QJ    CL 

E 

+->   to 

4->       '    QJ 

o 

oo   c    cn 

to   c  c 

C 

M-     S_     QJ 

re 

re  0 

QJr-    4J 

"O 

<u 

S-  t/1    c 

re  o  c 

re   0  re 

JD    S- 

to 

s-  0 

E   r-    4-> 

O) 

-M 

l^-             QJ 

O   -r- 

0 

0 

= 

QJ   4J 

--^ 

+->       -^ 

re  QJ 

o 

n3 

O   E 

>,         to 

>,        en 

•>-o 

4-3    3     C 

CD 

i/i  i/i  re 

4-     U  r- 

o 

+->    >i 

4->    4->   -M 

+->  S  s- 

•*->   S  c 

re  0  QJ 

c 

■n-    re  QJ 

0 

s^ 

Ol    <D 

S-           S- 

•^     Oi     3 

•r-     oJ  -^ 

4- 

S-           4-> 

c        s- 

QJ        - 

Cl- 

> 

o  4->  re 

r—   -r-     C 

4- 

re  ^  +-) 

(^ 

■1-    r—    J3 

4-)     C   XI 

0)   s- 

Q.  C    Q. 

re   > 

're   >  s- 

re 

Q.    0   -r- 

S- 

E   r-    4-- 

I/)    0    S- 

l/l     13 

OJ    <U    Ol 

3    O)    >, 

3    OJ    3 

Qj  re  s- 

3 

X3    QJ    3 

Qj  -c  re 

ZS    00 

t.    OOO 
I/O 

1 

re 

cr  S-  J3 

o-  s-  c 

oo  Ol   2 

C 

re  2  0 

4--    0.   0 

S- 

o  c 

00 

O    OJ 

+j  3 

a 

QJ 

QJ 

-M    C- 

Q.  E 

I/)           to 
00          O) 

to   0 

00   -r- 

ol 
QJ    C    QJ 

QJ    l/l 

s-  re 

O    i/l 

3   -r- 

CD           S- 

QJ    4-) 

E   0   E 

3    QJ 

S  -D 

C           3 

c   0 

0  Q.  re 

to   to 

-M   r- 

c  -a 

O)          XI 

QJ  re 

0    10    I/O 

C  -1- 

O 

CU    QJ 

>           CU 

> 

4->    QJ 

•r-   XI 

4- 

i.    S- 

•r-     C/1     O 

3    S-  4- 

O    S- 

■o  •■- 

4->  -        O 

4-3  - 

0            0 

0    QJ 

(O 

r—     3 

O  +J    S- 

U    4-) 

4-> 

4->    > 

io 

to    OJ 

•1-   cr 

a>  c  D- 

QJ     C 

XI     C    4-> 

O) 

^    >> 

J=    ou    5 

4-     QJ 

iti 

C    QJ    t/) 

>)*4- 

i- 

+J 

o  5-  re 

M-    E    o 

re  E  0 

re 

Z3 

fC  4-    <U 

QJ    +->  -r- 

QJ   4-> 

4-3  u 

S  s- 

00 

4->   r-   4-' 

o  >,'~ 

J-  c 

S- 

>>  s- 

0 

fO 

to    (C    (O 

o  >—  >, 

X3  re  -1- 

xi  re 

0  re    1 

QJ  <4- 

OJ 

JZ   +J 

x:  .-^ 

C    Q-.—    l/l 

C    Q.  to 

re  Q.  1 

> 

s: 

c        to 

O    (U 

•--  c  -o 

o  re 

to   cr.TD 

0)    Ol 

.  re  QJ  (J  -^ 

X3        re 

>,          C    OJ 

re  QJ  ^ 
XI  re 

>,          QJ 

S-    OJ 
3  X3  -V 

(_)        re 

•r-     C71 
4-J    C 
0   -r- 

+->  o  c 

H-  .—    S- 

o  ^   o  S- 

0  -c  s- 

0  ^     QJ 

QJ    4-> 

fO           ro 

O            -r- 

c:  4->       X5 

C  4J  ^ 

re  4--  s- 

«t-     S- 

NJ  X) 

C    3 

QJ  f—    t/l   -t-J 

QJ  1—  4-> 

>—  XI 

M-    0 

•>-    C    > 

S-   O  cr 

—  re  c  3 

•r-     re    3 

-  re  4-> 

QJ    Q.XI 

C    re  4J 

<D           0) 

O    QJ    O    O 

0    QJ    0 

XI    QJ    3 

QJ     QJ 

=i           C 

X)   cu  s- 

QJXI-r- 

QJ  sz 

QJ  ^    0 

4->     i-    4-> 

E    O    3 

E    4-) 

"t-            +J  X! 

M-           S- 

QJ 

to             00 

E    S   O 

3  re  to 

^4-  M-    U    C 

4-14-0 

a.4-  0 

0  Q  ••- 

•r-    4-)     (J 

c  xi  re 

QJ  o  re  re 

QJ    04- 

I/O     0   4-> 

E  CJ  r— 

§ 

+J 

(O 

^ 

o 

o 

u 

4-> 

+j 

c 

u 

o 

0 

0 

s- 

c 

3 

o 

0 

<-J 

4-)    0 

o 

0 

0 

QJ    Q. 

o 

o 

S- 

4-> 

4-> 

QJ    QJ 

QJ 

13 

1—1 

1/1 

u 

S- 

Q- 

0 

0 

JT  q: 

4-> 

S- 

>, 

4-> 

o 

Q. 

s- 

s- 

00 

I/) 

+-J 

-a  OJ 

s- 

+-> 

to 

D. 

a. 

J^  J^ 

>, 

to 

,—  > 

o 

o 

ct 

s-   re 

00 

c 

o  s- 

Q. 

S- 

to 

re 

to 

0    QJ 

1      =3 

OJ 

Q. 

to 

o 

2    S- 

C7) 

s-  00 

oc 

to 

XI 

C    4-> 

(O 

00 

+J 

"3 

QJ 

re 

•I-    to 

<u 

QJ 

0 

c 

to     3 

4->    QJ 

>- 

o 

4J 

S- 

■0 

0  0 

s-  h- 

1 

o 

01 

re 

QJ 

s- 

0 

0 

o 

sz 

re 

a. 

-Q 

re 

XI 

0. 

2 

o 

QJ 

Q) 

3 

re 

Q    C 

O) 

L_ 

1— 

(/I 

s: 

in 

1— 

t/1 

___ 

_s_ 

■^ 

6.19 


0) 

, — ' 

m 

(O 

■*->  <. 

o 

o 

6.20 


r 


USERS'  GUIDE 


FOR 


SEXUALLY  TRANSfllTTED  mm^ 
PROGRAn  EVALUATION 


June  1981 

By  the  Missoula  City-County  Health 
Department  (J.S.  Hand)  under  Contract 
#100325-01  with  the  Montana  State 
Department  of  Health  and  Environmental 
Sciences. 


r 


USERS'  GUIDE 
Sexually  Transmitted  Disease  Program  Evaluation 

CONTENTS 

Introduction Explanation  of  Evaluation  Project 

Scope  of  Sexually  Transmitted  Disease 

Evaluation 
Changes  from  Original  Evaluation  Plan 

Section  1 Gonorrhea  Protocol  — Staff  Procedures 

to  Insure  Consistent  and  Accurate 
Services 

Section  2 Patient  Survey  —  "How  Do  Patients 

Feel  About  Health  Department  Services?' 
"What  Do  They  Know  About  Gonorrhea?" 

Section  3  a.  Costs  of  Conducting  Gonorrhea  Program 

b.  Costs  of  Sexually  Transmitted  Disease 

Presentations 

c.  Costs  of  Contact  Investigation 

Section  4 Outcome  Measures  —  Repeaters  and 

Contact  Followup 

Section  5 Year-to-Year  Changes  in  County 

Gonorrhea  Rates 

Section  6 Original   Evaluation  Plan  for  Reference 


c 


INTRODUCTION 

Explanation  of  Evaluation  Project  -  This  Users'  Guide  demonstrates  seven  ways  to 
evaluate  your  Gonorrliea  Program  —  from  a  patient  opinion  and  knov;ledge  survey 
to  a  program  cost  analysis.   The  evaluation  methodologies  are   a  result  of  the  two- 
year  Community  Health  Services  Evaluation  and  Planning  Project,  conducted  from 
1979  to  1981  by  the  Missoula  City-County  Health  Department. 

The  evaluation  project's  goal  is  to  provide  practical,  efficient  evaluation 
methods  that  public  health  administrators  can  use  when  evaluating  their  own 
programs . 

Scope  of  Sexually  Transmitted  Disease  (STD)  Program  -  Because  gonorrhea  is  by 
far  the  most  comnran  of  the  13  sexually  transmitted  diseases',  this  evaluation 
is  specific  to  gonorrhea.   Each  evaluation  methodology  can  easily  be  modified  to 
cover  other  diseases. 

Each  evaluation  methodology  is  designed  to  smoothly  fit  into  your  health 
department's  existing  programs  and  to  produce  clear  and  immediately  useful 
data.   Because  the  Missoula  Health  Department  was  the  test  site  for  this  evaluatior 
model,  the  examples  shown  in  this  Guide  are  based  on  Missoula's  programs  and 
data.   You  may  need  to  modify  some  parts  of  the  evaluation  to  fit  your  programis' 
features,  or  expand  the  evaluation  to  other  disease  programs. 

Each  section  of  the  Guide  shows  Missoula's  test  results,  discusses  evaluation 
procedures,  reviews  evaluation  models,  and  provides  any  forms  used  to  collect 
data.   Program  cost  analysis  worksheets,  sexually  transmitted  disease  reporting 
forms  and  other  documents  are  copy-ready. 

^'  nges  from  Original  Evaluation  Plan  -  An  evaluation  plan  is  simply  a  brief  out- 
line of  proposed  work.  When  parts  of  the  Sexually  Transmitted  Disease  Evaluation 
Plan  proved  infeasible,  they  v/ere  dropped  and  other  parts  were  revised: 

1.  Evaluation  Objective  1,  Patient  Interviev/s  —We  decided  not  to  interview 
patients  to  see  if  gonorrhea  protocols  had  been  follov-yed  because  of 
potential  violation  of  patient  confidentiality. 

2.  Evaluation  Objective  3,  Contact  Cost  Worksheet  — There  was  no 
significant  difference  between  the  cost  of  contacts  who  were  located 
and  those  not  located.   The  contact  cost  analysis  was  simplified 
from  original  plans. 


chancroid,  condyloma  acuminatum,  donovanos i s ,  gonorrhea,  herpes, 
lymphogranuloma  venereum,  molluscum  contagiosum,  nonspecific  urethritis, 
pediculosis,  scabies,  syphilis,  and  trichomoniasis. 


3.   Evaluation  Objcictive  h,    Repeator  Risk  Score  —  We  feel  the  risk  score 
"^^  is  impractical  since  its  results  would  be  open  to  debate.   Studies 

have  shown  that  repeaters  are  at  risk  for  STD  because  of  their  sexual 

activity.   If  repeaters  know  they  should  be  examined  and  know  vyhere  to 

go  for  treatment,  their  STD  education  has  been  effective,  not  ineffective. 

h.       Evaluation  Objective  5,  Test  of  Three  Reporting  Options  —  Changed  to 
one  reporting  system  which  incorporates  telephone,  mail,  and  computer 
reports  from  three  different  groups  of  physicians.   (For  a  complete 
description,  see  Communicable  Disease  Users'  Guide,  Section  1.) 

5.   Evaluation  Objective  6,  Control  Groups  — The  Missoula  Health  Depart- 
ment does  not  offer  school  nursing  services,  which  include  STD  information 
presentations  to  classes. 


(■ 


Section  1 

gonorrhea  protocol 

staff  procedures  to  insure 

consistent  and  accurate  services 

Resul ts  -  The  Gonorrhea  Protocol  replaced  a  general  outline  in  Missoula's  Out- 
patient Care  Center.   Clinic  and  field  nurses  followed  the  new  protocol  to 
thoroughly  test  it  and  be  sure  the  protocol  covered  all  steps  of  patient  inter- 
views, examination,  and  treatment.   After  the  protocol  was  finalized,  Outpatient 
nurses  reviev'^/ed  twelve  patients'  visits  to  see  if  their  care  followed  the  protocol 
Their  evaluation  showed  that  staff  did  closely  follow  the  Gonorrhea  Protocol. 

Discussion  -  Protocols  are   one  clear  way  to  insure  program  quality  and  consistency 
They  are  also  an  excellent  staff  training  tool.   The  Gonorrhea  Protocol  was 
designed  to  be  used  by  any  health  department,  although  it  may  need  changes  to 
fit  your  program's  policies. 

Methodology  -  To  get  the  most  use  from  protocols,  they  should  be  updated  at  least 
yearly,  after  they  are    tested  and  finalized.   To  keep  protocols  current,  add 
addenda  and  corrections  promptly. 

Evaluating  the  use  of  the  gonorrhea  protocol  is  difficult.   Missoula's 
technique  was  to  have  the  Outpatient  nurses  (who  routinely  use  the  protocol) 
review  12  patients'  visits  by  checking  the  protocol  steps  they  followed.   Other 
methods  of  evaluation  could  be: 

1.  Peer  Review  -  another  member  of  the  outpatient  staff  interviews 
her/his  coworker  and  asks  if  each  protocol  step  was  followed  and,  if 
not,  why. 

2.  Outside  Review  -  an  independent  member  of  the  nursing  staff  listens  to 
the  patient  interview  and  records  protocol  steps  that  were  followed. 

3.  Patient  Interviews  -  another  nurse  interviews  the  patient  and  asks 
whether  certain  protocol  steps  were  followed. 

Each  evaluation  method  has  distinct  problems,  whether  confidentiality,  staff 
relations,  or  bias  introduced  if  staff  act  differently  when  they  know  they  are 
being  evaluated.   Sel f-review  worked  best  for  the  Missoula  Health  Department, 
Dut  you  may  prefer  another  method. 
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OUTPATIENT  CARE  CENTER 

GONORRHEA  PROTOCOL 
Missoula  City-County  Health  Department 


Thin  ijroiocnl    ic   intciided   to  serve  an  a  n tev-hu-r,tep  procedure 
for  nurr.rr,    to  follou  in  examininr]  and.   treatdnn  /jonorrhea 
patient^;.      It   is  tioi  int. eroded  as  a  tn'aining   tool,    hut  rather 
as  a  guide  for  trained  l^Ns.      A   case  is  defined  as  a   laboratory 
co?t firmed  diagnosis . 


FEMALE  PATIENTS 
I.   Initial  Visit 

A.  introduce  yourself 

B.  assure  client  of  confidentiality 

C.  fill  out  VDRL  form  (sample  page  9) 

D.  fill  out  STD  Report  form  completely  (sample  page  10) 

1 .  be  sure  to  date  and  fill  in  all  applicable  blanks 

2.  ask  specifically  if  client  has  had  any  unusual 

a.  discharge 

b.  lower  back  pain 

c.  lower  abdominal  pain 

d.  spotting  between  periods 

3.  if  client  is  contact  of  positive  gonorrhea  case  and  has  acute  PID 
symptoms,  then  refer  to  private  physician  for  treatment,  especially 
if  client  has  lUD 

E.  draw  blood  for  VDRL  (a  routine  screen  for  syphilis  -  to  be  done  on  all  pt£ 

1 .  write  patient  name  on  vacutainer 

2.  take  vacutainer  to  lab  and  let  blood  sit  for  at  least  2  hours  before 
centrifuging 

F.  conduct  exam  -  explain  all  procedures  to  patient  thoroughly 
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ask  patient  to  remove  clothing  from  waist  down  .and  provide  with  drape 

place  clean  slides  and  culture  plates  on  table 

put  2-3  drops  saline  on  1  clean  slide  (be  sure  frosted  side  of  slide 
faces  up) 

position  patient  on  examining  table 

examine  external  genitalia  for  sores,  warts  and  unusual  discharge 

with  forefinger  in  bottom  of  vaginal  opening,  insert  warmed  speculum 
(do  not  use  lubricant  other  than  water  because  of  possibility  of 
adverse  effects  on  culture) 

1.2 


CUTIWriE;.T  CARE  CtNTE:! 

^J  gongrrulA  protocol 


'Tliis  protocol  is  intended  to  S2rve  as  a  stcp-hjj-otep  ppoacdo'j  for 
rmrcp.c  to  follow  in  examining  a-nd  treating  gonorrhea  patients.      It 
it;  not  intended  ar.  a  training  tool,   hut  rather  a--  a  guids  for  train-jd 
I'Ns.      A  case  is  defined  cs  a   laboratory  confir,ued  diagnosis. 


r-EMALE   P  AT  I  r  NTS 

I.      Initial   V-isit 

A.  Introduce  yorrself 

B.  Assure  clienL  oT  confidentiality 

C.  Fill  out  VDRL  forn  (sample  page  9) 

D.  Fill  out  STD  Report  fonn  completely  (ssmple  pace  lO) 

1.  Be  sure  to  date  and  fill  in  all  ai>pli cable:  !ilanks 

2.  Ask  specifically  if  client  has  had  any  unusual 
•1.  discharge 

b.  lower  back  pain 

c.  lower  abdominal  pain 

d.  spotting  between  periods 

e.  pain  with  intercourse 

3.  li  client  is  contact  of  positive  gonorrhea  case  and  he.s  acute  PIl 
symptoms,  then  refer  to  private  physician  for  treatment,  especially 
if  client  has  lUD. 

E.  Draw  blood  for  VDRL  (a  routine  screen  for  syphilis  -  to  be  done  on 
all  patients) 

1.  IJrite  patient  name  on  vacutainer 

2.  Take  vacutainer  to  lab  and  let  blood  sit  for  at  least  30  minutes 
before  centrifuging 

F.  Conduct  exam  thoroughly  -   explain  all  procedures  to  patient 

1.  Ask  patient  to  remove  clothing  from  waist  down  and  provide  with  drape 

2.  Place  clean  slides  and  culture  plates  on  table. 

3.  Put  2-3  drops  ?;terile  saline  on  one  clean  slide  (be  sure  frosted  side 
of  slide  faces  up) 

4.  Position  patient  on  examining  table 

5.  Examine  external  genitalia  for  sores,  warts  and  unusual  discharoe 

6.  With  forefinger  in  bottom  of  vaginal  opening,  insert  wai-med  spcculu.m 
(do  not  use  lubricant  other  than  water  because  of  possibility' of 
adverse  effects  on  culture). 

7.  Locate  end  of  cervix  and  position  speculum 

8.  If  large  amount  of  wliite  or  yellow  discharge,  clean  cervix  with  s./ab 

9.  Take  culture 

a.  Use  first  sterile  swab  to  collect  vaginal  discharge  and  stir  irto 
saline  on  slide  1 

b.  Use  sterile  swab  to  collect  discharge  ar.'Vor  secretioiis  frc.i 
cervical  os  after  removing  excess  vaginal  discharge  -  swab  should 
remain  in  os  for  15-30  seconds  and  be  rotated  gently  to  collect 
bacteria 

c.  Roll  swab  on  slide  2.  Do  gram  stains  only  if  purulent  discharge 
or  highly  suspicious  of  gc 

d.  Gently  roll  on  blood  agar  plate  (if  discharge  is  minimal,  use 
third  swab  to  collect  more  discharge  from  os  and  dab  or  roll  slid'j 
label  culture 

e.  Remove  speculum  gently 

G.  If  patient  indicates  oral::ac^ i ta  1_  and/or  rectal^  intercourse 
1.  Pharyngeal  culture 

e.  Explain  procedure  to  patient 

b.  Apply  sterile  swab  vigorously  to  posterior  pharynx  and  tonsil lar 
crypts  -  swab  should  remain  contacting  throat  for  15-30  sectni!s 

c.  Roll  swab  on  culture  plate  gently,  using  isolation  technifim  , 
label  and  place  in  incubator  for  two  days. 

1.3 


2.     Ano.l  culture 

a.  Expl;jin  j.roro'J'.ire  cnrc ru]ly 

b.  Insev-t  SLPvile  swab  i.-,ie  wich  in;:o  anal  canal. 

c.  riove  swab  rrcm  sid^i  to  r.ic.e  ir;  canal  to  r.an.ple  cr-ypts  allowing 
1j-30  seconds  for  orcjanisrns  to  be  absorbed  onto  sv;ab 

d.  Roll  swab  on  culture  plate  usirq  isolation  techni(]UG  and  [)lace 
ir:  incubator  for  two  full  ■iays 

Fimanual  pelvic  examination  aiJ  palpatation  of  lo;.'er  abdomen  to  discern 

cervical  motion/adencxal  LMiderness  and  to  check  for  pelvic  masses.  If 

patient  indicatfs  contact  vlth  diagnosed  gonorrhea  case,  verify  cuse, 

and  treat  according  to  CDC  recoirmendaticns  and  Health  Department  policies 

(Refer  pregnar;t  v/oiuen  suspected  of  PID  or  .  lergic  to  penicillin  to  ov;n 

physician.)  Discuss  observations  with  patient,  providing  pertinent 

reading  materials  to  further  answer  questions. 

Ask  patient  l:o  dress  and  wait  in  the  clinic  room  lor  slide  results  - 

ask  her  to  read  literature 

Have  lab  read  and/nr  confirni  gram  stain  results 

1.  Graiu  stain  cervical  slide  as  follows: 

a.  Air  dry  slide  for  sever ^.1  niinutes  (optional  -  flanie  slide  by 
quickly  passing  sli.;,'  over  bunsen  burner  flame  3-4  times, 
discharge  side  up) 

b.  Cover  surface  of  slide  v/ith  crystal  vio'iet;  lee  stand  5-10 
seconds,  then  rf>n.ove  with  a  gentle  stream  of  water 

c.  Cover  surface  or  slide  with  firam's  iodine;  let  stand  for  50 
seconds,  then  remove  with  gentle  stream  of  water. 

d.  Decolorize  with  acetoiie-alcohol  for  5-10  seconds  or  until  no 
more  ourplc  color  is  removed  from  smea-.-:  rinse  slide  again  in 
gentle  stream  of  water 

e.  Cover  slide  with  sairanin  for  5-10  seconds;  rinse  with  w^<ter 
and  pat  dry  on  paper  towel 

?..     [j.ami'ne  slide  for  gonococci  as  follows: 

a.  Add  one  drop  of  immersion  oil  to  slide  ever  smear 

b.  Focus  on  discharge  first  with  low  power  (small  objective  with 
green  rings) 

c.  Swing  high  powered  objective  [red  rings)  into  place  and  focus 
on  discharge,  using  the  fine  focus  knob,  turning  carefully  to 
avoid  crussiitng  the  objective  against  the  slide 

d.  Look  for  ^ram-negative  (.red-colored),  intracellular  diplococci. 
Grem  stain  results 

1.  If  results  &Tii   negative,  instruct  patient  Lo  cell  health  department 
in  two  days  for  culture  results  and  avoid  se);ual  contact  un^il 
results  are  known 

2.  If  results  are  positive  or  if  patient  was  in  contact  with  a  known 
gonorrhea  case,  treat  for  GC  and  make  specific  appointment  for 
test-of-rcure;  conduct  contact  interview. 

3.  If  slide  is  positive  for  yeast,  treat  with  monostat  cream;  if 
positive  for  trichomonas,  treat  with  flagyl;  if  positive  for 
non-specific  vaginitis  treat  with  Ampicillin  or  flagy!  (bee 
protocol  for  standing  orders  I'or  vaginal  infections) 

4.  Appearance  rr'   culture  positive  for  qonococci 

a,  Gross  r..,  phology  -  sm^^-ll  round  yr;'y  transparent  colonies, 
non-heihO lytic,  non- spreading 

b.  Gram  stain  -  qrem  negative  (red)  diplococci 


II.     Vaqiii^i    Infcc'Jons  -  Sl..inuiiin  Ore'  rs:     "ihns^  Oi.'irs   ar  .   for  fcvijle  p: ,:  i  ■ -i ';  . 
tli.it  '  av:  a  venereal  riijOise  checK  and  a   vMii;iiv;t  i  >  o'^oblcm  is   "■r.riic^tnd. 

A.  Y-Mst   liifecMons 

1.  Vai:irial  yeast  infection:,  are  usually  Jiagnoird  vrith  a  wc-t  slide., 
the  procedure  is  as  folio..-: 

a.  Kxamir.e  a  fre;  h  saline  p^-:paration  imd.-'-r  lew  pov.ur  (green  r;,v  .  ) 
noting  numbers  of  pus  cells  and  opithclial  cells  (ord  ••"uri  ly 

you  will  not  see  large  number-  of  pus  cells  with  a  yeast  inier.tioni 

b.  Swing  in  high  dry  objective  (yellow  rinos)  and  again  examine  rreo, 
lookir-n  at  the  kinds  of  bacteria  present  (ordinarily  yeasl:  cud 
lactobdcte>-ia  will  co-exist) 

c.  Swing  in  low  power  objective  again,  add  1-2  dvi^^:,  iC/o  KOH  and 
stir  prep  wit.'i  wooden  applicator  stick,  rocus  with  low  power. 
then  swing  in  high  dry  objective 

d.  Host  epithelial  cells  and  pus  cells  will  swel"!  up,  occominn 
large  spheres;  bacteria  and  yeast,  if  present,  will  be  una f footed 
and  will  stand  out 

e.  Yeast  will  appear  oval  in  shape,  are  raucii  large'^  than  most 
bacteria,  may  have  small  rouiid  "buds"  attached  or  in  chrciiic 
yeast  infections,  may  have  long  "tubes"  extending  from  yeast 
cell 

2,  Treatment 

i'oitistat  7  vaginal   cream  (niconozole  nitrate  2%).     One  apulicato' 

intra-vaginally  once  daily  at  bedtime  until   l^ibe  is  completely 

used  up  (7  days).     Give  patient  information  and  instruction  handou   . 

a.  Adverse  Reactions:     Vulvovaginal   oUeding,   itching  and  irritation 
of  vagina 

b.  Prec.iutions :     If  used  in  the  first  trinu.ter  of  progr.ancy  a 
physician's  approval   is  necessary 

c.  Contraindications:     Known  hypersensitivity  to  this  dr..'g 

B.  Trichomonas 

1.  Trichomonas  infections  are  diagnosed   vith  a  \,et  slide;  the  procedu> a 
is  as  follows: 

a.  Examine  a  fresh  saline  preparation  under  low  power  (g;  een-rir,ged 
objective),  noting  numbers  c ''  pus  cells  and  epithelial   cells 

(as  a  general   rule,  many  pus  colls  are  seen  with  triciiofnonas 
infections) 

b.  Look  for  "rou:idish"  cells  which  m'giit  be  moving  in  cir,  1e:-  or 
appearing  to  spin  in  place 

c.  Swing  in  high  dry  (yel  law-ringed  objer.tiv-;)   and  examine  a:;" 
"■moving"  cell;"  lock  for  one  or  more  cellular  flagella  or  t.nls 
which  would  bo  propelling  the  organi.-m  through  the  saliiv.'. 

2.  Treatment 

Flagyl  -  8  tablets  250  mg  each  stat  (total  rOCO  mg).  V;oman  i;;ay 
also' take  b   tablets  to  hor  steady  sex  partnor.  ^jive  i'no>-ma\;ion 
and  instruction  handout. 

a.  Adverse  Reactions:  Darken' ;i  urine,  arti<,ara,  nasal  crngestions 
and  dryness  of  mouth.  Cys',  itis  and  p.Hvic  n>-c.ssu-;;  havv.  bi^c-n 
reported.  Known  to  cause  cancer  in  la^  rats. 

b.  Precautions:  Do  not  give  to  lactoting  •vciioi..  A i. acholic 
boverages  shauld  not  be  consu  ied  for  72  baurs  afiaar  tii3:'.>;jv  i^r 
severe  abdominal  cramps,  nausea,  vomicir,a  and  iiecd;'.ciii.^  r-ay  ccc..' 

c.  Contreindicetions :  Evident,  of  history  o"   blood  dyscrasi  :, 
first  trimester  of  pregriincv.  and  pricr  s^ii  j""  ■"."■  v  i  ty  to  'iaoyi 


f:oi:-specific  Vaginitis 

1.  Dii(;nosis  . 
Clun  cells  (m  c.=^line  preparation;  rniino   ("fishy")   odor  on  ac.diLKri 
of  KC;i.     Ab.cnco  of  fungal   elements   and  trichoiponas . 

2.  Trc-!tment 

Treat  with  Ampicillin  500  nig  qid  x  7  days.  If  allergic  to 
Penicillin  nive  Flagyl  250  mg  tid  x  7  days.  If  Aiiipicillin  dees 
not  relieve^syniptorns  give  Flagyl  250  qid  x  7  days.  If  all  these 
attempts  have  failed,  have  patient  see  own  doctor.  With  any  of 
the  above  Piedications,  if  the  patient  is  still  symptomatic  aft'jr 
treatment  at  the  clinic  she  should  be  referred  to  Planned  l'are,;L- 
hoou  or  her  private  physician  i'or  further  care. 
Venereal  Warts 

A'jply  20%  podochyllin  solution  to  external  warts  only.  Inte.nal  or 
cervical  warts' must  be  referred  to  private  physician.  After  five 
(5)  treatments  (one  week  between  each  treatment)  if  wart  isn't  gone 
refer  to  private  physician.  Give  venereal  wart  instruction  and 
information  sheet. 
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i'\f\\y.  PATiEi 


I.      Initial   Visit 

A.  IntrcducG  yourself 

B.  Assure  patient  of  confidentiality 

C.  Fill  ouL  VDRL  form  (sample  page  9 ) 

D.  Fill  out  STD  Rejjort  form  completely  {semole  page  10) 

E.  Draw  blood  for  VDRL  (a  routine  screen  i'or  syphilis  for  all  STD  patiL;: 

1.  Write  patient  name  on  vacutainer 

2.  Take  vacutainer  to  lab  and  let  blcod  sit  for  at  least  30  niinute^^ 
before  centrifuging 

F.  Physical  Examination 

1.  Inspect  skin  of  genitals,  inguinal  areas,  thighs,  lov/er  abdcii.en, 
hands,  palms,  and  foreatris 

2.  Inspect  pubic  hair  for  lice  and  nits 

3.  Inspect  penis,  retract  foreskin,  inspect  nit:atus  and  "milk''  urethi 
for  discharge 

4.  Palpate  scrotal  contents 

5.  Palpate  for  inguinal  and  femoral  lymphadencpathy 

G.  If  patient  having  discharge,  dysuria,  possible  STD  contact  do  grarn  st 
explain  possibility  of  having  NGU 

1.  Explain  procedure  to  patient 

a.  "Milk"  urethra  for  discharoo 

b.  Use  swab  tc  collect  from  urethra  and  roll  swab  across  slide, 
then  roll  across  labeled  culture  pi  ate 

c.  Gram  stain  slide  -  Incubate  culture  plate  for  two  days 
H.  If  patient  does  not  have  discharge 

1 .  Explain  procedure 

2.  Insert  calgiswab  1/4  to  1/2"  into  meatus  and  twirl  sv/ab  for  3  se^ 

3.  Roll  s'jab  across  labeled  culture  plate 

4.  Incubate  culture  plate  for  two  days 
I,  If  patient  indicates  rectal  intercourse 

1 .  Explain  procedure 

2.  Insert  swab  approximately  one  inch  into  anal 

3.  Move  swab  from  side  to  side  to  sah^ple  crypts 
for  absorption  of  organisms  onto  swabs 

4.  Streak  labeled  culture  plate  using  isolation  technic]u(. 

5.  Incubate  for  two  days 
J.  If  oral -genital  intercourse 

1 .  Explain  procedure 

2.  Swab  vigorously  posterior  oharnyx  and  to 
seconds 

3.  Streak  labeled  culture  plate  usir;g  isolation  tecnniqne 

4.  Incubate  for  two  days 

K.  If  patient  has  positive  gram  stain  or  is  contact  of  por-itive  qonorrl 

case,  treat 
L.   If  gram  stain  negative  for  gonorrhea  but  tl](?ro  is  puruloric  or  iwlu.o- 

purulent  urethral  discharge  and    i-j  f^firVlCOnx  field  r.\:c\]   tr.ML  I'ui' 

nongonococcal  urethritis 
[I.  Contact  Interview  (See  page  1-8) 


cana ! 
allowing  15-20 


crypts  fo) 


(mrACT_!:pTR;at:M 

:.c--lrtcrvi.ev  for  corrbudts  for  the  pa^t    '60  dcvja  prior  to  syrmyi-oi-iSy   io:7.^.sr, 

usymptomat  i-c ,    th3n  use  professioi-iol  jud-jnent. 
.uil c-~IntAir'jieui  ha</K  to  onset  uf  nexl-to-luist  menstrual  period. 

Conii/letely  fill   out  "Contact   Intervievv"   recticn  of  STD  Report  i'onn 

A.  Ask  number  of  different  partners 

0.  Explain  that  you  need  each  partner's  ncune  and/or  description  so  uu'.t 

you  vn'll  know  that  they  have  been  examined  and  treated  if  necessary 
C.  Give  patient  a  chance  to  refer  contacts  to  treatment  at  health 

department,  doctor.  Planned  Parenthood  or  U  of  U   Health  Service 
U.  Have  patient  list  most  recent  exposure  first  and  v/ork  back  for  30 

dfjys  (male)  or  onset  of  next-to-last  menstrual  peiiod  (female);  kL 

names  first,  theii  go  back  later  for  descriptions,  address,  etc. 
L'.  Leo  patient  knov;  that  any  contacts  he/she  does  not  want  to  locate, 

the  health  department  will--for  tnese  contacts  get  complete 

descriptions: 

1.  physical  description,  age 

2.  employiTient/school 

3.  living  conditions/locaticn/friends 

4.  residence  in  ilissoula/recenc  travel 

5.  hangouts,  etc, 

6.  dates  of  exposure 

riake  specific  appointment  for  tost-of-cur.-^  and  advise  patient  that  if 
he/she  is  a  no-show,  a  field  visit  will  be  niide  and  contacts  will  nr.ed 
to  be  followed  up  iQiied lately.,  because  they  deserve  the  same  opportunity 
for  treatment  as  the  patient 
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TrST-OF-CUR£   I[iri-:;V 


I.     If  patient  (loss  not  return  within  tun  days,    'y-.c;;;  attGmot  to  loccte  i-.y 
phone;   if  unable  to  locate  witli  three  pl^.onij  r.allr. ,  notify  field  cpi  '  j-i- 
iologist  Lisintj  EpideniiolocMc  Report  form  (saniplo:  pane    11) 
II.     If  patient  dooi  return  for  appointrn;;nt  or  within,  ten  days,  then 

A.  Check  with  patient  to  insure  that  ali   contacts  have  been  notified 
and  exanrined.     Also  verify  with  communicable  disease  STD  prcccH^ure 

B.  Conpletely  fill   out  bottom  half  of  page  Z  of  bl'D  Rf.iort  Torn'--- 
'Techeck  visit"  section 

C.  Culture  patient  at  appropriate  site  rsing  procedure  as  discussed 

1.  advise  patient  to  return  to  clinic  at  any  time  that  he/sh  :■  rhin';?; 
reinfection  has  occurred  (statistics  shov  that  15%  of  gc  pa'. iei.tr 
are  reinfected  within  six  weeks) 

2.  If  patient  rematn.s  positive,  then  first  check  '-'or  reinfection 

a.  if  patient  has  been  reinfected,   re-treat,  stressing  sexual 
abstinence 

b.  If  patient  has  not  been  reinfected,   (if  reinfection  is  ruled 
out);   treat  with  spectinonnjoin  hydvoc'nloi'ids,    2  c,m  IM  in  on<i 
incectiaa  while  patient  is  in  clinic.     Imoortant  to  follow-up 
contacts  vigorously  to  halt  possible  spread  or'  penicillin 
failures,     Cultures  should  be  tested  for  beta-lact  ama'.o 
production 

3.  If  patient  is  negative,  make  sure  tliat  all  contacts  have  been 
examined  and  treated  if  necessary 

D.  In  addition,  on  all  women  patient-  do  rectal   culture;-,  for  test-cf-C'.'r<: 
III.     Test-of-Cure  Interview 

A.  Review  list  of  patient's  contacts  to  see  v.'ho  has  been  examin.d    uid 
where;  verify  while  patient  is  in  office 

B.  Follow-up  any  non-referred  contacts   (either  clinic  nurse  or  stat  ■ 
field  epidemiologist  through  use  of  Epidemiology  Report)  with  infonia- 
tion  from  patient 

C.  If  patient  is  positive  at  tost-of-cure,  interview  carefully  to  rule 
out  reinfection  or  to  determine  source 


Unccmpl  icatcd  A;K)gonital 

A.  If  patient  'is  n^ri^  allergic  to  pr-nici  i  "I  in ,  i;v  r-^  1,111-:::   J.:  ;,=.;  y- 
mouth  loiih  1   ^nn  -probe}! p,yid  bj  mcuh  ■:.o.!  i)i-i n'-M^e'l  at    ih:  ^-:0?K'    c    -i". 
Inforn;  patient  of  "instructions  for  comrrU::   frtiontr;  iollo/infj 
treati'iGiit".  Have  patient  v^ait  for  IS  nrinui.^.-  in  the  v^nfinj  roo:,i 
in  case  of  adverse  effects  of  medication 

3.  If  patient  i_s  allergic  to  penicillin,  prof-^nocid  or  s"  I  ron;ii,:i('.-u  or 
has  hepatic  involveniant,  history  of  hcn^olyLic  a(,iniia  (k'o  to  glue  f^. 
G  phosphate  dehydrogenase  (G-G  i-D)  deficiency,  has  knc' .'n  renal 
impairnent  or  is  or  Black  race  uT.rj  be  tr^  ay  aline  hydvoohlovi'i';  0.,    {■"'• 
by  month   4    tinei:  per  day  for  5  days    (total   -■  10  ams . )      Explain  p,  e- 
cautions  for  tetracycline  (page  !.¥,).     Patient  v/ait  lij  minutes 

C.  Make  appointment  for  patient  4-7  days  afi'er  coni|)letion  of  tht;r3;!''j 
follow-up  any  patients  not  iceeping  test-of-cm-e  appciintniant 

Priaryngeal  Infections 

A.  If  patient  is  n_ot  allergic  to  penicillin  use  4.8  n:'.llicn  imiva  of 
aqueovj;  procaine  pe'nioillin  G   (AtTG  4.B  million  units)   I.M.    dividbo. 
into  at   least  2  doses  and  injected  at  different  aitea  at  2  visit, 
together  with  1   om  of  probenecid  by  riouth  Juf^t  before  the  injection. 
Advise  patient  of  "instructions  for  gc  patients  folloving  tre£tn:.ent". 
Have  patient  v/ait  for  15  minutes  in  the  waiting  room  in  case  of 
adverse  effects  of  medication. 

B.  If  patient  i_s  allei^gic  to  p  nicillin  use  tetracycline  hyd:ro chloride 
0.  b  gnt  by  mouth  4   times  per  day  for   5  days  so   that   total-  dose  eq:-als 
10  rrms   explaining  precautions  for  tetracycline  (paqel.;14).  (If  p  ■.ient 
is  allergic  to  probenecid  or  sulfonamide'^,  has  a  history  of  her.ioiyl.ic 
anemia  due  to  glucose  6  phosphate  dehydrogenase  (G-6  PD)  dei'lciency , 
or  has  [:nown  renal  impairm-^nt  or  is  of  Black  race,  use  this  regii  ir-n. ) 
Have  pa'/ient  wait  for  15  minutes  in  v;aiting  rooni  in  case  of  adyc:rse 
effects  of  medication 

C.  If  patient  has  been  treated  for  anogenital  gc  and  is  later  found  to 
have  pharyngeal  infection,  treat  with  minocycline  bOO  ng  orally   in  c. 
single  dose.      Halve  patient  v/ait  15  minutes  'in  case  of  adverse  effects 
of  medication 

Non-Gonoccocal  Urethritis  (NGU/NSU) 

A.  If  patieiit  is  not  allergic  to  tetracycline,  give  tetracycline  O.i  ;,  v 
4  times  per  day  by  mouth  for  7  days  (total  dose  =  14  gms)  explain1n«i 
precautions  for  tetracycline 

B.  If  tetracycline  is  contraindicated  give  erythromycin  500  mg  (flu  x  7  do 

C.  If  patient  has  steady  sex  partner  refer  in  for  oxain  and  treatiricirc 

D.  Ask  patient  to  call  health  department  after  treatment  is  coiiip.leced; 
if  at  that  time  discharge  continues,  refer  to  privale  physician-  if 
patient  denies  discharge,  close  chart 

Other 

A.  Acute  salpingitis   (pelvic  inflanmatory  disease);   refer   to  own  doctor, 
follov/-up  v/ithin  one  week  and  refer  positive;  gi-iir^ccocal    infecti' .-!- 

to  state  field  representative  immediately 

B.  Recent  sexual  contacts  who  are  negative  on 
patient  identifies  positive  index  case,  tri' 
contac':  aS  if  they  have  uncomplicated  anog, 
report  as  gc  case,   hov/ever) 
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SECTION    / 

PATiET'T  su:r/;:Y 

'KOW    do    f^M^CNTS    FF.EL   ABOUV    HLAL"^>i    DFJ'ARTMHNT    SERVICES?" 


"WMAT   DO    THEY    KNOW   aBOUT   GOi^ORRHEA?" 

Results    -    Survey    I     Intervievyecl    patients   v/ho   cc■.;■^e    to    the   Outpatient    Care    C.  iric 
for    tlieir    initial    exam  a, id    treatment.      Ttie    results    stiowed    tiiat    the   primary    i-eos'  a 
patients    came    t)    th^.    Outpatient    Care   Clinic    for    STD   cxann;   v;a5    p.'ivacy   and 
c".  if  icent  !al  i  ty  ,    not    cost   or   convenience.      Pctients    generally    first    heard    o:o'.:t 
tl:o    1-lealth    Dep3rtm!"'rit '  s    Clinic    from   friendr.    and    Planned    Parenthood,    and    the   odds 
yiere  about    50~50    tiut    they   ha  J    been    to  a    \d   clinic    before.      Re.  pondents   did 
rot    feel    charges   were    too   high.      Fatienos   were   vet-y    positive   about    the   an,.jj.,t 
cf    time   nu'ses    spent   with    them,    but    resii     ■    seem    to    indicate    p    tients   may   Wci't 
more    STD    information    from    the   nurses.      Ge-.erally,    patients    knevj  about    STD 
transmission,    prevention,    and    long-term   '     fects.      Respondents'    educational 
levels    ranged    '  roiii    tenth   grade   or    less    {11%)    to   a    high    school    education    (37^-T  • 
Forty-two   percent    h.d   at    least   one   year   of    college   and    MZ   graduated.      The 
Clinic    scved   ma  i  r.  I  y    low    income    patierits    (yer,  rly    income    less    than    $3,000), 
a: chough    \o%    reported    they    have   annujM     inccue   of    $lA,0G0   and   above.       (See   pane 
2.6    for    the    full     report.) 

■Lirvty    II     i  ntervi  cv/f.d    patients   who   came    to    the   Outpatient    Care   Clinic    for    th"i'- 
-.e';  t-of-cure   exam.       Patients    generally    first    heard   about    the    Clinic    *^ror;   f;  ,c-.:...'s 
.    ,d    Planned    Parenlhood,    and    there  v/as   a    50-50   chance    the   person    had    been    to   a   VD 
Clinic    before.       Patients    felt    Health    Department   charges   vice   about    right,    cn!y 
124    felt    the    fees   vjere    too   high.      Nurses   gave    patients   as    much    information    a-. 
^"hey   wanced,    s^-ont   enough    time   with    them,    and    seemed    to   care   a'^out    the    patients 
I    'dici'    problem.       Ironically,    only   8L  '    thiugf.t    they   v/ould    come    to    the   Health 

Ta,     ..at    if    they   needed    to   go    to   a   VD   clinic   a::iin,    possibly    because    they    do 
not    plan   on    contacting    VD   an. -in.       The   majority   of    patients    ki:ew   about    STD 
tr    -iSiii  ss  I  on ,    prev:ntion,    and    long-term   effects.      The   education    level    of   !-at'':nts 
wat.    Prom   eight, i    gr.ide    to   a   masters    le\'el;    l3?   had   eleventh    grade   or    less    edL:cr.  .lor 
h]  _.    had   c    high    school    edurition,    ]3Z   had    some   college   education,    6%   had 
gre''uated    from   college,    and   6%   had    a   masters    degi'ee.      The    Clinic    served   mos':iy 
1  ov/    income   patients,     i !  come    less    than    $3,000   per   year,    althiough    23%    repci'ted 
income   of    -l^.OoO   and    aPove.       (See    page   2.13    for    tiie   full    re[)ort.) 

Mis'-.oula's    survey    resul'.s   viere   used    to   change    serine   outpatient    procedures. 
Since    seme   patients    said    they   were   uncomfortable  w^hen    asked    the    reason    fc^r    'd.eir 
visit   w!i  i  1  e    they   v.'ere    in    the   waiting    rooni,    sign-in    pi'ocedures   were   changed. 
T'le    si'rvey   also    sh.ov.'ed    that    fev/   people    learn   about    the   Outpatient    Care   Center 
though    thr:   media,    so    the    Department    rent    Public    Service   Annouficcmen  ts    to    lecio 
':i\d    television    'cj    increase    Clinic    name    recogi:  i  t  i  en  . 

Di'-cnjsj_on    -    C    nducting    a    patient   opinion    survey    Is    an   excellent   way    to   gM 
t'eedback    from   vour    p'atients.      The    results   o*^    the   Missoula    surveys   were    very   well 
received    by    rLai'1'    ^irJ    admi  n  i  s  ^  ra  t  Icn    alike,    and    the    survey    procedure   was    continue 
in    FY     1982. 


Recoinnendation  -  Ask  patients  to  fill  out  a  questionnaire  while  tiiey  are  still 
in  an  examination  (or  private)  room.   Tlie  pretest  of  tfie  Mis^-oula  surveys  si. owed 
that  handing  out  questionnaires  in  the  waiting  area  is  very  tiirea  :.en  i  ng  to 
patients. 

Methodology  -   Survey  sample  size  at  the  ^SZ   confidence  livel  (plus  or  minus 
.5^  accuracy)  is  ginerally  determined  by  this  formula: 

(N)(.25)     _  . 


N  ~   number  of  patients  per  year 
n  =  sample  si^^c 

If  surveying  a  valid  sample  size  is  impractical,  try  to  survey  all  patients  for 
at  least  three  months.   Although  your  sample  size  v%fon '  t  be  strictly  valid, 
three  months  should  give  you  a  fairly  accurate  indicator. 

Survey  forms  may  be  Lised  either  as  they  appear,  as  examples,  or  miodified  to 
fit  your  individual  program.  f\   sample  is  shown  on  page  2.3. 

1.  Initial  Visit  Survey  —  Give  each  STD  patient  a  questionnaire  at  the  end 
of  their  clinic  visit  < nd  ask  them  to  fill  out  a  survey  and  placu  it  in  a 
sealed  box.   Do  not  ansvver  questions  about  survey  items  or    help  the  patient 
in  any.  way.   If  a  patient  refuses  to  complete  a  survey,  explain  the  purpose 
of  the  survey  once  more.   if  patient  still  refuses,  conclude  the  visit. 

2.  Test-of-Cure  Patient  Survey  (to  see  if  patients  v-;lio  have  been  given  STD 
information  know  more  gonorrhea  facts  than  Group  l)  —  Same  procedure  as 
1. 

Le  sure  to  give  each  patient  a  survey  form  to  avoid  biasing  the  s:.irvey. 
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co"'MUNnY  ii[:AL"n^  SL.^/iCrS  !3/al-Uation  and  planning  proj^tct 


SU^TARY 

Vc.i  will  st?rt  S3einq  articles  aboiir.  the  Evaluation  Models  in  most  of  the.  i^jte- 
wide  nev.'S letter-;  as  '.e' 1  as  national  newsletters  end  journals.   Final  repor  :s 
ore  enclosed  and  include  &ct   Home  Health  Referral  Study-Final  Report,  Hciie  li-^alth 
Referral  Record  revision,  Sexually  Transmitted  Disease  Outcome  Statistics  Report, 
S"^"D  Opinior.  Survey-Part  II  Report,  and  Communicable  Disease  Proiotoi  revisions. 
It  was  a  pleasure  v.-orking  with  everyone  and  I  iiopc  the  models  are  used  and/ir 
read  on  a  regular  basis. 

PROJECT  BACKGROUrlD 

This  year's  Evriluation  Project  objectives  focus  on  f :  vs  major  areas: 

1.  To  consult  with  evaluation-model  users  ai  least  bi-monthly  to  ans  .■ei- 
possible  questions,  solve  problems,  or  refine  evaluatioii  methodologies. 

2.  To  continue  yearly  program  cost  analyses,  surveys,  statistics,  and 
other  methodologies  as  needed  by  program  admi  n  i  str^- tors  . 

3.  To  continue  to  analyze  data  from  ongoing  evaluations. 

A.   To  de/elop  additional  evaluations  as  requested  by  participating  health 
departments. 

5.   To  respond  to  statistical,  evaluation,  and  miscellaneous  information 

requests  by  other  health  departments,  as  well  as  the  public  as  tim,'.  allows. 

Continuous  evaiuat  on-model  testing  in  Missoula  County  vyill  i'lsure  that  statistics, 
protocols,  questionnaires,  and  methodologies  are  current  and  providing  useful  data 
for  program  rranagei^s. 

PROJECT  STAIl!^- 

This  is  tlie  last  q'jarter  of  the  Community  Health  Services  Ev'aiution  and  Plar'ning 
1-roject.   Final  -eports  are  included  and  each  department  will  receive  one  last 
phone  call  to  clear  up  questions. 

Clinic  nurses  completed  self-evaluations  using  the  gonorrhea  protocol,  resulting 
in  a  major  procedural  change  in  the  Sexual  1  v  Transnii  tteJ  Disease  protocol.   The 
clinic  ni'rse  will  now  take  ail  swab  tests,  ■■ath'-'-  tii.-n  explaining  the  procet'u.-o 
to  the  male  paiicnt  and  having  him,  perTorm  t!ie  sv/ab   test,   This  '".hould  iielo 
increase  reliable  tests.   I'he  revised  protocol  is  enclosed  and  replaces  the 
old  protocol  in  the  STD  Evaluation  Mode'  Users'  Guide. 

Al':hough  it  took  over  a  yeur,  the  STD  'atient  Jpinlon  Survey-Part  M  was  cc"o!etec! 
in  Ji'n3.   This  survey  inter-viewed  tes  t-of-cui  e  patients.   Results  show  test-o;-cure 
patients  are  niore  knowledgeable  about  STD  transmi  s-^  ion ,  prevention  and  lor'--cer-'i 
effects,  more  comfortable  In  coming  :.:o  the  clin.ic,  .jnd  more  satisfied  with  tiie 
information  tiie^/  obtain  from  the  nurses.   The  major  dif^erenct,  beLweci!  the  laru 
1  and  II  survey  is  the  response  to:  "Why  f' i  d  you  choose  i:c  come  to  the  Health 
Department  Clinic,  instead  or  going  soifeivTierc  '-Is.-:;"   Part  ii  reseltb  show.:d  est 
was  a  factor.  Part  I  ruspondents  were  i.^o:  ^^  c-n -^M-n.'.d  'vi'h  conf  i  den  t  i  al  i  tv  .   Tivrc 
arc   a  couple  possii,;::  exolana  t 'on ;,  !";:>r  t  ic  ■  /iicli.  (l)  it  riay  refect  ;;i  -■■  j;i  i  a '  s 
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poor  economic  situation  and/or  (2)  patients  are    first  concerned  about  conf  i  ;,>ent  iai  i  Ly , 
once  tliis  issue  is  resolved,  cost  becomes  more  important.   ilie  Part  II  Survey 
Report  is  enclosed,  along  VN/ith  a  revised  Section  2  introduction  v-;|-iich  replaces 
pages  2.1-2.2  in  the  STD  Users'  Guide 

The  Outcon.e  Statistics  Report  for  FY  1982  should  be  added  to  the  STD  Users'  Guide, 
Section  4. 

The  Prenatal  Education  Users'  Guide  called  for  conducting  a  twC'-month  follcv,'-i:p 
of  all  pai'tici pants  taking  classes.   Missoula's  class  fo.mat  changed  substantially, 
making  it  difficult  to  complete  this  survey.   Telephone  interviewing  problems 
were  accentuated  and  the  study  was  not  completed.   Please  replace  Section  3  Tv/o- 
Month  Fol low-Up,  vnth  the  revised  copy,  noting  the  addition  of  a  Results  section. 

The  Home  Heal th  Referral  Protocol  was  developed  to  help  Increase  the  number  of 
accepted  referrals  to  the  home  health  caseload  through  consistency  from  referral 
to  referral.   A  record  review  from  May  I98O  -  April  I98I  and  May  I98I  -  April 
1982,  should  have  revealed  the  effectiveness  of  tlie  Protocol.   This  did  not 
occur  because  of  a  staff  turnover  in  the  middle  of  the  seccnd  year.   The  ne'.v 
staff  person  v;as  not  aware  of  the  Protocol.   A  report  is  presented,  with  general 
results,  for  your  information  (Report,  pages  4.9-^.12).   If  you  are  currently 
using  this  Protocol,  you  could  conduct  your  own  study  by  comparing  results  from 
referrals  taken  before  and  after  protocol  utilization. 

As  a  direct  result  of  the  Referral  Protocol  study,  changes  were  made  to  the  Referral 
Record  (4.5a).   The  major  changes  are  the  addition  of  spaces  for  Medicaid  ar;d 
Medicare  clnim  numbers  and  extra  patient  status  categories.   The  question  "Hov; 
did  you  first  learn  about  Home  Health  care?"  i.s  deleted  because  it  is  not  asked 
during  the  coui se  cf  the  interview  since  the  majority  of  referrals  come  from 
physicians  or  discharge  planners.  1 

Requests  are  still  coming  in  for  the  Home  Health  audit  and  evaluation.   This  . 

indicates  the  need  for  such  a  tool  is  needed  and  wanted  by  home  health  agencies. 

The  response  to  the  model  has  been  very  positive  and  many  of  the  18  agencies  arc 
using  one  or  more  methodologies. 

Several  revisions  were  made  to  Commun  icabl e  Pi  sease  protocols,   The  enclosed 
copies  replace  pages  from  the  current  protocols.   A  nev/  tuberculosis  protocol 
is  in  the  writing  stages.   if  you  are  interested  in  receiving  a  copy  oi"  this, 
please  contact  Bill  DeCou,  301  West  Alder,  Missoula  MT  59802,  ('4O6)  721-5700, 
36/4. 

The  Subdivision  Reviev;  and  Licensed  Food  Establishment  m.odels  did  not  have  any 
changes  or  additions  made  this  quarter. 

OUILQQK 

Articles  on  the  Evaluation  Models  have  been  submitted  to  state-wide  newsletters, 
and  national  magazines,  pending  acceptance. 

This  is  the  last  report  you  will  receive  concerning  this  Project,  it  was  a 
pieasur::  v^orkinq  with  everyone.  Reviewing  each  model  on  a  yearly  basis  may 
orovQ   b.'nef  ic  ial  to  programs  and  departments.         //  /')/]        .    .? 

Susan  Plath 
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f;ei:nis  l.ong,   Nir-sin^  Director 
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bur^'sy  rssuils  show  cf)St,  convenic-nce  anc!  confidentiai  ii;y  ere  equally  li'r.e'i  ' 
'rf^asoiiS  tes t-o1--ci.ire  (ParL  11)  pationts  come  to  tnc  Health  Ds^ortv:-' nt  for  >:ar?.. 
i^atiants  'jciTsrally  first  liear  abc-jt  the  Clinic  from  friends  and  Plaiiiied  Pcu'eni:- 
hood,  and  there  is  a  50-50  chance  the  parson  has  been  to  a  VD  clinic  befor^j. 
Patients   feel  Health  Departn^n'   '■   argf,  are  about  right,  only  12%  feel   the 
fees  are  too  high.     Nurses  give  patieiits  as  much  inforr.aticn  as  tliey  v.'ant, 
sper^d  enough  tim3  "^'ith  then.,  and  seam  to  care  about  the  patients  medical 
probiem.     Ironically,  only  88%  think  they  would  come  to  the  ileal th  Drpart- 
insnt  if  thf:^y  r,eed  to  go  to  a  VD  clinic  again,  possibly  because  they  do  not 
plan  on  contacting  VD  again.     The  majority  of  patients  do  know  about  STD 
transmission,  prevention,  and  long-tevri  effects.     The  educatio.i  level  of 
patients  runs  from  eighth  grade  to  a  r.iasters  level;  18%  have  eleventh  grad-: 
or  less  edurat-;on,  -11%  have  a  high  school  education,  19%  have  som^  college 
edjcation,  6i  have  graduaced  from  college,  and  6%  have  a  masters  degree.     The 
Clinic  serves  mostly  low  income  patients,  incom-:;  less  than  $3,000  per  year, 
nlthouoh  23%  report  income  of  $14,000  and  above. 

Laa ^<grovnd  -  Ecrper-.menta l_ D 3 sign 

The  research  design  calls  for  (1)  survey^"nq  patients  v/ho  come  to  the  Out- 
patient Care  Clinic  for  their  initial  exam  and  treatnient  (Par":  I\  and  {?.) 
sur'/eying  r.  different  group  of  p?;tients  who  return  for  thiir  t' ^L-of-cure 
(Part  II). 

We  'ivpothesized  tiiat  the  second  group  of  test-of-cura  patie.its  would  (or 
at  least  should)  show  higher  levels  of  knowledge  and  comfort  with  their 
visft  to  the  Health  Department's  clinic  and  more  satisfaction  with  infcrmacion 
provii'ed  to  th:m.     Using  this  research  design  avoids  the  pcssibility  of 
survey  irg  patienis  twice  and  influencing  tiieir  ansviers  or  percepticn  the 
second  time,  or  making  \  hem  i/ore  sensitive  tlian   j.hey  m.jy  have  otherwise  been 
to  infonnation  tl.ey  get  at  the  Clinic. 

The   first  survey  ran   rroM  December  1,   i380  through  February  15,   1981.     Thirt:; 
seven  completed  tiuestionnaires  w:^re  received  for  that  ti.ne  period,   stctistics 
show  tne  Clinic  sees  V  STD  patients  r,Q'r  month.     The  second  survey  Kin  iro'A', 
/".pril   1981  tlirough  I'^'ay  198--.     A  total  of  17  completed  questionnaires  were 
received  for  that  time  period,   eigiit  ^hort  of  a  statistically  valid  sample 
bize.     Statistics  siiow  the  fiinic  sees  5  test-of-cure  petienls  ■^-^r  ,!onth. 
Because  the  required  nrmber  jf  c'jestionnaires  were  not  com.-if: ted,  Ihese 
r-e^.ul^s  provide  r  ,  indicati       .m"  '\-itiCiit  knowledge,  satisra-tion ,   .'n-i  bocio- 
tccnor::'c  r'laracteristics  o;;)y.     'lir:  Clinic  nurses  did  a  go"d  Job  ':/:  as!  irg 
patients  to  fill  out  the  gu'^t ici-i  aire,  b^it  v/ere  at  times  hampered  oy  n  rusn 
of  patien'.^,    ciio  );eed  to  hav?  cli.iic  ruoms  free,  or  the  lac-'  of  test-of-curo 
patieii^s  d'jr-io  the  st'j'.iy  p..riod. 


:'.n 


Part  ii 
Paga  2 


j'\C:;uli:.j 


lii':-  format  for  this  ::e(:tion  is  the  same  for  each  quostion.  The  question 
appears,  iollov/ed  by  results  for  both  Part  II  and  Part  I,  respectively,  <>! 
an  analysis.  Part  II  y^espondents  are  test-of-cirra  patients ,  while  Part  I 
respondents  vere  initial  ex^in  rmd  treatnic-nt  patients. 

1.  Hovj   did  VOL!  first  find  out  ahoi't  the  Clinic? 


Part    Ii 

Response   Categories 

Pari:    1 

^nt 

Friends 

'(8^ 

^% 

Mewspapei-  or   Radio 

1% 

2k% 

Planned   Parenthood 

\7X 

(>% 

Doctor 

1% 

0% 

VD   Hot    Line 

n 

lk% 

Otiier 

Poverello   Center    (6'^) 
Hospital     (12°^) 
Unkfiown    (6^) 

2S% 

Welfare  Office  (2?^)   Just  Knew  (5'l) 

School  Program  {2%)        Crisis  Ceriter 
Sister  (5'^)  (•■"<^) 

TV  (2?0  Unki^cwn  (S%) 

Guessed  (2^) 

Analysis:   Although  there  is  a  slic;ht  increase  in  the  percentag;-.  of  doctors 
referring  patients  to  the  Clinic,  v'e  still  need  to  ask  -  Should 
the  Clinic  be  receiving  more  referrr.'s  from  doctors?  Word-ov 
mouth  referrals  are  still  hig!")  and  referrals  from  Planned 
Parenthood  have  increased.   The  VD  P.ot  Line  appears  an  ineffeciivo 
means  of  referral . 

2.  Have  you  ever  been  to  a  VD  clinic  before? 

Yes,  v.Mthin  the  past 
35%        12  months.  19? 

Yes,  more  than  a  year 
(■>%  ago.  32?o 

53%  No,  never  before  h'-)! 

Analysis:   Pxesults  from  this  quest  ion  sho'v  Lhe  majority  of  clinic  test-of- 

cure  patients  are  first-time  STD  patients.  Opposite  the  result:^ 

or  the  Part  I  survey.   An  interpretation  of  the  question  mr.y  hnve 
caused  some  of  the  difference. 

3.  Wh_y  did  you  choo_se_to  cotjie  to  the  Health  l^epartment  CI  in  ic,_  jnsi^_aci_cj^ 
going  somevjhere  e  1  s e ? 

Z0%  cost  less  25% 

lb%  easy  to  find/convenient    V-3; 

26?       confidential  and  private   k(.Z 
V]%  other  1'-!% 

friend  came  here/told  me       have  ;^o  regular  doctor 

i  better  come  in  only  place  i  know  to  go 

was  told  to  report  it  here     iiiy  iiealth  and  no  money 

by  doctor's  receptionist      stai f  informative  and  easy  to 
ir.orc  knowledgeable  than        talk  to 
private  physician  department  ;-,e(;:iiiS  to  speci^ii  ■/..:•  •■•.\   VO 

di<ii^'c  know  K.,(^^e  ei;;c  to  o:> 
fret 


J 


Dt  ii'.s  i-r..:: 

STO  Pa"ie!v:  upir.icn  Suv":^.; 

?z-rc  II 

Pace  3 

/,.      Wi-,y   ci  id   )'o  \   choose    t      corn:^    tc    ri..     ;-;-^3  ■  vh    Derv!  "-li.^'iit    "  IjjJ '  - in:.te;id   of 

c^  )_i_n n   soine.vhcrn  eKc_V    (co.it,) 

Analysis:      An    i  iit';resLi  ig   sv.'it.ci.    in   tlie   rea-oii  v/hy  pc-ople  co'f.j   to    this 
lieaith   Department.      Confident  ial  i  ty  v.-as    ^;.;ponant   foi"   ;art 
!    patieKts,   wiii'e   cost   ^;as   siightly  ivore    ii,iporl;::;nu    to   Pari 
I!    patlencs.      There  are  a   couple  i.ossiblc  oxplanntions    for 
this   switch.      This   could   be  a    reflection  vf   t'r.z  poi- ■  economic 
situation    in   Missoula   d'jrinc    the   s?con"    survey  <jr   patitnts 
are   firsi.   coixerned   ai:;out   confidentiality.      Once   tiiey   are 
norc   coiTifGri:c.h1e  v/i  lli    tlva   confidentiality    issue,    cost   bicoma:. 
more    important. 

h.      Compared   ro  other  p''aces,    do  you   feei    the  Heait;-,   Deportir  ;nL '  ?  VD  charges 


0% 

V/ay  Too  lligii               OS 

^2% 

A  Bi,;  Too  M'qh             3% 

kvz 

Aboi-t  RJqht              53% 

1^.% 

A  Sit  Le::s  Expensive       19? 

Q% 

V/ay  Less  Zxpensive        19% 

'M 

No  response 

Analysi  s: 

:   If  these  results  are  presented  ii 

Part    !!   -   VA%,    Part    !    =  3%,    (2)    about   rioht,    Pare    Ii    -  kM, 
Part    1    -  33/0,    s\>i'^    (3)    less  expensive.    Part    II    -=  13%,    Part 
I    =   38?!,    results   shov/   the  charge    is   not    turning   people  away. 
Only   a   small    percentage    feel    the   charge    is    t  ;o   expensive. 

Please   circle   the   ncfiber  closest    to  hov;  you   fej]  : 

a.    If  yoo  ever  need   to  co   to  a   '\/D  ciinie  again,   wo'jld   you   prefer   to  go 
somevhere  else? 


problera::':' 


532^ 

probably  n-^ 

n% 

35?^ 

deiinitely  no 

2S% 

(>% 

maybe 

d%. 

i% 

probably  yes 

0% 

76% 

definitely  ye;: 

o3% 

2h% 

proba  •)!  /  yes 

21% 

0% 

maybe 

5Z 

0% 

oef i  n  i  tely  no 

■:t 

the 

nurse 

spend  enuijgii.  t 

i  :n<:-  '■. 

;tl:  'ou' 

76/: 

defin  i  tel  v  y.--z 

Zn 

zh% 

prooaLiy  yes 

(•% 

0% 

definitely  no 

y. 

A.      Did    (.'iie   nurse  give  yon   as   irucn  i  nfo'ifiiit '  .j  1    :'S    /i 

100%       definitely  ye;        ?^a 
0%  prolably  ye;.-  ~  i% 

0%  de  inltey  -c  ;  - 


D^-  ,:.n!s  Lang 

S'lD  Patici:t  Ooinion  Survey 

Part  II 


Please;  circle  the  nnifn^er  closest  to  hnw  you  fe?,'i  :  (cont.) 

Analysis:   Tcr'>t-or--cui'o.  patients  should  show  ir.ore  sat  i  sf;;Ct  ion  '.'ith  in. or- 
niation  provided  tf'iem  than  the  Survey  i  (initial  extiu:;  p^Lie'. ts. 
This  hypothesis  proved  true.   The  strongest  yes   shov;.~  ni:rs.;5 
give  patients  as  much  information  as  they  want,  oppo;,ei!  to 
Part  I  results  where  the  strongest  yes  shows  ni:rses  spend  c-.,ouq! 
time  with  patients. 

The  most  significant  difference  batv;ccn  ti~ie  two  Surveys  v;-.s  tls.: 
decrease  in  the  number  of  poople  wlio  would  return  to  the  iici'ltf 
departm,ent  if  they  ever  had  to  go  to  a  VD  clinic  again.   Th':; 
could  possibly  be  because  they  do  not  plan  on  riecding  a  VD 
cl inic  again. 

Please  circle  the  number  closest  to  how  the  clinic  made  you  feel: 


Part  3 2 1 C 1 2 3. 

ii  embarrassed  coi.ifortab  le 

and   awkward  and    relaxed 

6%  12?  12?;  MX  ^.y/o 


Part 
i 


s%       nz       2k%       }Gi       kn 


Analysis:   One  hypothesis  is  the  second  group  surveyed  (cest-of-cure  p:.tients) 
should  show  higher  levels  of  comfort  than  the  first  survey  group. 
At  the  extreme,  comfortable  and  relaxed  (3),  the  comfort  level 
was  higher  for  test-of-cure  patients.   This  coincides  with  positive 
responses  to  5(a-d).   As  reported  in  the   Part  I  report,  the.o  is 
still  room  for  improvement. 

The  first  symptom  of  gonorrhea  in  men  is: 

6%         usually  no  sumptoms        G% 

burning  pain  v;hen  urinating 

Zl%  and/or  a  discharge-!-       Z\% 

stomach  pains  and/or 

Q%  backache  Ql 

n%  not  sure  13^ 

The   first   syniptom  of   gonorrhea    in  vjomen    i  s_: 

0%  cran'ps   and   backache  3% 

Q%  sore  on   sex  organ  k% 

SS%  usually   have   no   symptoms+  63/0 

35^  not   '<ufe  2S% 


2.16 


.nv\ 

.Til 

Pr.t. 

',\r\'. 

.      a1 

l'.X[M: 

ij 

:.. 

T!;^ 

Ci 

.lurvey 


to  pi-evont  .-ii-t^irK 


use   bi  rtli   cor  r.rol    i;i  1  1  s 

O/o 

u;;c    rubbers   Oi'   cor.'oni^-i- 

obv 

■  irini'to  an-.:   uouclit;    r  i  jht; 
.. rter   sex 
not   sure 

31 

ic:    imoi  ications   of   gnnorrh?^- 

'    in 

both   moi 

:  a'il  tnat  appli,) 

i  rrhri  tis+ 

\5% 

::,evere,    con3ta;it   back   pain 
stsril ity+ 

heart   disease-^ 
ir.-ani  ty 

'6% 

85; 

o% 

\3% 

k6% 

o% 

M% 

1.      Pelvic    inf Inmrnatory  diserse    (PID)    is  a  co.a^TiQn  complication  of  isntreato 
gonorrhea,    but  "is    rarely  very   serious  cnu    is  easily   treated. 

12%  true  6? 

hlZ  false  13-0 

411  not    sure  o]% 

Analysis:      Hypothesis   -   Survey    II    respondents   should   be  mc-re  !<nowle!:je 
than    the.  Survey    i    respondents.      OueGtior,.';   7  ~   11    v.ere  c.?oir; 
to  prove/disprove   this   hypothesis.      Overall,    the  te-.^  t-cf-ri: 
patients  were  more  kncv/ledgsable   than   Part    !    respondents   - 
riypo thesis    is    true. 

Lookini]   at   each  question    individually,    fev.'ar   i.^erolc   -niswer^.. 
''Question    'lO  correctly.      T'r.ere  'vas  oaly  a   silent    i--,- 1  ovaifenL 
in   correct   answers    to   QMcstions   1   -   3,   vvith    the.   bi'.g.st 
improvement  on   Question    11.      [ivcn   ',;i  th    these    irnpr'r  ac.an  :':• , 
there    is    room   for   further    iniprcvomen!:    -    t  lie   highest   correct 
response  was  only   88"'  correct   on   Question   9- 

'"  ■      Please   circle   th..    last   year  of   sciiool    that   yoti   cor.ipieteJ. 

6;>  =  8tn  (\rade  -      3^:  12^  -  13th  Grade  -  15"                     &?  =  H-- 

0^,  -  9th  Grade  -     3%  \1%  -  i4tn  tirade  -=  15&                               Ph. 

'0%  =1Gi:h  Grade  "      "^-Z  OA  -^  15th  '>-ade  =     G!' 

o5;  -  llthf^rade  -     o;>  G%  -  iGth  Hrad-.:  =  12^; 

irR   -  12th  ih-ade  =   3/-<; 


J 


J 


STD  P^rtiGi.u  Qjinioi,  Su)' 
Fart  11 
Fa  no  6 


IMcTie   circle    tlie    Icist    v-ir   oT    sc^iool     th;:':    you    c-0;::^lr 


'.C  . 


'sis:  The  majority  of  pr.cirnts  hnvi^-  at  ]t.^3t  ;:  hl:^':  schc 
although  ]bZ  Co  not.  Tv.onLy-ninc  peri^crit  '\,?-3%)  !"■<■ 
college  educaLion.  These  results  arc  very  bimiia; 
first  survey  i^eiult'^'-.  There  are  strcno  iiapl  i  _a  t  Ic 
heal  ill   education. 


iovi  o!  n   arsycui 


0? 

lA  or  unHer 

0% 

5-19 

59% 

;:o  -  2h 

M% 

25  -  29 

U% 

30  -  3'i 

:?.% 

35  ar.d  over 

38? 

2h% 

3% 

\1% 


Vi. 


'!',  % 

Hale                     lk% 

■1:,% 

i^e:7iale                   26? 

GX 

Mo  :espon.:.e               0? 

Wl^a: 

is  your 

approxi-iate  yea-'ly  income,  bcfor: 

i  0°j 

under  $5,-00             k\% 

35:s 

$  5,000  -  ^  7.353         25? 

MZ 

$  8,000  -  $10,53y         12? 

\1% 

$11,000  ■-  $13,939          n 

11% 

$U,000  anu  abovj          id? 

\  '    vv;i 

i.it  ways 

would  y-c  !i!,e  ?-o  so?,  the  Clinic 

__£'-'-ii?    '\'?'-''"'-    '■ 

''..kle  Kutiei  (Ooacci  kctp  f^o'i  ^cJlay.atio;i  iCv/Ji  n^atz  ix^":^ ;•:...  6 . ' 

"0:1  W.J  (i-otit  v.(J>.tt  the.  liLLUs.  .iUQp.C-i.tad  'nonopomtj  cvc.  U: 
■xoLU'.d  h'Z  'ir.itj  .to  cwo.id  VO .     I   tko-.ighi  tlui.i -it  ;<':i^  veA.':.d . 
I'k't  citt.  pui'ple.  (Viii  ailz.  -to  (ic.hui.ve,  i:.ono2Ci.-,u  jjo-^,  ic  vcjii:'-:'] 
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Tliis  survey  wr^s  designed  to  proviuo  info;:' •  "ion  cnir^erning  knov/l'^rln:?, 
comfort,  and  satis  racti  en  levels  cf  c2SL-oi-'-c;;ro  patients.     The  rcsrlts 
indicaie  test-of-cure  patients  are   (sliglicly)  innro  knowlcdqeablc,  more 
comfcrti^blc,  nad  rcorc;  satisfied  tiion  the  inirial   vi^it  ['clients  intirvic;.; 
in  the  first  siirvey.     Hovvevi^r,   there  is  still   rcoiii  for  iriiprovenient  in  th( 
areas. 

Ic  v;as  a  pleasure  conipiling  these  results  for  you. 

cc:   David  Feffer,  Health  Officer 

Ethel   Montgoinery,   Field  Supervisor 
Jan  Veleber,   RN 
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Section  3 
a.  costs  of  conducting  gonorrhea  program 

Results  -  Missoula's  Gonorrhea  Program  cost  $7,085  in  FY  I98O.   This  cost  in- 
cl udes  $1 1 .02  for  each  patient  examined  and  found  negative,  and  $17.25  for  each 
gonorrhea  positive  patient  (For  examination,  treatment,  and  test-of-cure)  . 
Missoula  administrators  revised  charges  for  gonorrhea  services  to  better  reflect 
actual  cost.   The  cost  analysis  provided  budgeting  and  program  planning  for 
FY  1981  and  1982. 

Discussion  -  To  be  accurate,  program  costs  should  come  as  much  as  possible  from 
staff  time  sheets,  supply  purchase  records,  and  patient  statistics.   You  can  use 
estimates,  but  the  cost  analysis's  over-all  accuracy  will  be  reduced. 

Methodology  -  See  the  detailed  explanation  on  the  back  of  the  program  cost  analysi5 
(page  3.3)  and  an  example  (Missoula's  results,  page  3-^)-      A  department  overhead 
analysis  is  shown  on  page  3-5  and  3.6  (item  k   on  the  cost  analysis). 

B.  COST  OF  SEXUALLY  TRANSMITTED  DISEASE  PRESENTATIONS 

Results  -  Because  tfie  M.is'.'vil.i  \\i-.;,]lh    Departiiient  do';s  n(jl.  r(;'jul.jrly  provide 
school  nursing  services,  staff  gave  only  one  talk  in  FY  I98I.   The   cost  of 
that  presentation  was  $1.27  per  student,  or  $^10. 75-   Although  this  was  not  a 
good  sample,  v^e  felt  the  cost  data  is  representative. 

Discussion  -  This  information  is  easy  to  collect.   Each  time  a  staff  member  is 
asked  to  present  venereal  disease  information  to  the  public,  they  should  fill 
out  a  STD  Information  -  Time  and  Audience  Card  (shown  page  3-7) • 

Methodology  -  By  simply  calculating  the  costs  of  each  presentation  as  shown 
on  the  card  and  then  adding  all  presentations'  costs  yearly  (or  monthly,  quarterly. 
or  semi-annually),  you  will  have  total  cost.   Program  overhead  can  be  estimated 
at  12^  of  personnel  costs  and  department  overhead  can  be  figured  by  using  the 
worksheet  shov^n  on  page  3-5  and  3-6- 


C.  COST  OF  CONTACT  INVESTIGATION 

Resul ts  -  Based  on  173  contact  reported  by  gonorrhea  patients  in  I98O,  each 
contact  cost  $6.10  to  investigate,  for  a  total  yearly  cost  of  $1,055-  These 
cost  figures  helped  the  Nursing  Director  plan  tiie  FY  1982  budget. 

Di  scuss  ion  -  Cost  information  is  easily  gathered  by  filling  out  a  short  Gonorrhea 
Contact  Card  for  each  contact.   The  pretest  of  the  form  showed  that  its  biggest 
problem  was  staff  forgetting  to  fill  out  the  forms.   An  alternative  is  to  fill 
out  a  form  for  a  set  time  period  of,  say,  three  months  to  get  a  good  sample 
Results  of  the  sample  can  be  used  in  lieu  of  a  full  year's  data. 


Section  3,  Page  1 


Methodology  -  Fill  out  one  form  for  each  contact,  breaking  time  down  into  five 
minute  intervals  for  both  phone  and  field  investigation.   Mileage  should  be 
figured  to  and  from  the  office,  or  as  a  proportion  if  the  trip  was  for  more  than 
one  purpose.   The  forms  may  be  tabulated  quarterly,  or  at  the  end  of  the  sample 
period.   Use  the  results  of  the  Contact  Card  to  fill  out  the  Cost  Analysis. 

The  Gonorrhea  Contact  Card  (page  3-8)  is  an  easy  way  to  compute  staff  time  and 
mileage  costs.   That  information  can  then  be  used  on  the  STD  Contact  Cost  Analysis, 
which  computes  the  actual  costs  of  contact  work,  including   program  overhead 
costs  and  general  department  overhead.   (To  compute  the  department  overhead, 
see  page  3- 5) • 
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.1.  Personnel:  RN  tinie/qc  pi  x  (-iciKTry  +  fringe) 
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b.  L,it);  T.-cf.  lime/gc  test  x  (salary  >  fringe) 
X  /''  pts  screened   (■■"■'  /  ' 


inie/gc  test  x  (salary  +  fringe) 

x  .■•'  pts  screened  and  retested  (Col    l>) 


Nsq  Adniinist  rat  i  ve  Costs  : 
Nsq  Director 

Nsq.  Supervisor 

Clerical  Suppor 


2.  SUPPLIES 


b.  lest    lubes/pt    x    /»    pts 

c.  swabs 

d.  slides 

c.    stain/emersion    oil 

f.    culture    plate 

q.     forms 

h.    niedicatioti 

i.    medication    container 

i  .    sterile   appl i  cator 

k.    needle 
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EXPLANATION' 
(\C   Pro  I' ram  Cost  Anal  v. si; 


Note:      h'aak  depax'tment  will  have  its  own  system  of  tracking  personnel    time  spent  on 
disease  investigation  and  surveillance.      The  cost  analysis  worksheet,    designed  to 
provide   the  "lost  coyroenient  method  of  determining  program  costs,    can  he  changed  to 
reflect   the  depa.rtment '  s  specific  situation.      The  Gonorrhea  Cost  Analysis  Worksheet 
is  split  into  two  sections   to  show  the  cost  of  screening  suspect  cases  of  GO  and 
to  find  the  costs  of  treating,    administering  tests-of-cure,    and  of  following  up 
contacts  of  t-ositive  GC  patients.      The   two  categories  are   then  added  to  show   the 
total  program  costs. 

1.   Outpatient  Clinic  (if  applicable) 

i'ersonncl  -  "RN  time"  means  :iverage  time  spent  on  an  "average"  patient,  and  should 
include  filling  out  records,  counseling,  reading  GC  tests,  reviewing 
literature,  phone  calling  to  doctors,  etc.  (Col.  A),  as  well  as 
treating,  counseling,  tests-of-cure,  giving  results  by  phone,  etc. 
(Col.  BJ .   (You  may  want  to  conduct  a  time  study  to  give  you 
accurate  time  per  patient.)   If  more  than  one  nurse  works  for  the  OPC , 
you  should  use  an  average  hourly  salary.   To  find  the  exact  number  of 
GC  patients,  refer  to  the  State's  Monthly  Gonorrliea  F^eport. 

I.ab  Technician  -  (If  applicable.)  [ncludcs  all  time  spent  by  the 
microbiologist  on  each  patient  and  test,  including  reading  tests, 
consulting  with  nurses,  etc. 

Nursing  Administrative  Costs  -  This  category  includes  the  costs  of 
administering  the  GC  program  from  the  nursing  director  on  down.   To 
allocate  costs,  one  of  three  methods  can  be  used  (in  order  of  pre- 
ference): 1)  hours  budgeted/spent  by  administrative/support  personnel; 
2)  percent  of  time  budgeted;  or  3)  best  available  estimate  of  hours 
spent.   To  be  very  accurate,  comprehensive  time  sheets  should  be  l^ept 
by  all  personnel  and  others  involved  in  case/outbreak  surveillance 
and  investigation.   The  administrative  costs  should  be  the  (number 
of  hours)  times  (salary  plus  fringe  benefits)  for  each  category. 
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i'Joic:      :<ii:'h  Ji<-'t.>ai'L>ht->it.  will    'uc.iK    ita   own  syctetn  of  Lraakin-j  per:\'-yn>:ci    t'-tna  ni.Cfit  o>i 
diseane  uiuc.^ Liijatton  an  I  nuf^.-'ilLanae.      The  cost  analysir,   wovksshect,    designed   In 
pyuoide    t,he  '-'ost  conH'Mient  method  of  determining  progpcm  cocts,    can  he  changed   to 
I'efleat   the  depurtment'r,   ^i>ccifiL;  situation.      The  Gonorvhea  Cost  Analysis  Worksheet 
is  split  in.  to   hoo  sections   to  show   the  aost  of  screening  suspect  cases  of  GC  and 
to  find  the  costs  of  treating,    administering  tests-of-cure,    and  of  following  up 
contacts  of  posftive  CC  patients.      The   two  categories  are   then  added  to  show    the 
total  progvivn  costs. 

1.  Oiit.]xit  ient  C\  inic  (if  .-ippl  i  cable) 

Personnel  -  "RN  time''  means  average  time  spent  on  an  "average"  jxiticnt,  and  should 
include  filling  out  records,  counseling,  reading  GC  tests,  reviewing 
literature,  phone  calling  to  doctors,  etc.  (Col.  A),  as  well  as 
treating,  counseling,  tests-of-cure,  giving  results  by  phone,  etc. 
(Col.  I^J .   (You  may  want  to  conduct  a  time  study  to  give  you 
accurate  time  per  patient.)   If  more  than  one  nurse  works  for  the  OPC , 
you  siiould  use  an  average  hourly  salary.   To  find  the  exact  number  of 
GC  patients,  refer  to  the  State's  Monthly  Gonorrhea  Report. 

Lab  Technician  -  (If  applicable.)  Includes  all  time  spent  by  the 
microbiologist  on  eacii  patient  and  test,  including  reading  tests, 
consulting  with  nurses,  etc. 

Nursing  Administrative  Costs  -  This  category  includes  the  costs  of 
administering  the  GC  program  from  the  nursing  director  on  down.   To 
allocate  costs,  one  of  three  methods  can  be  used  (in  order  of  pre- 
ference): 1)  hours  budgeted/spent  by  administrative/ support  personnel; 
2)  percent  of  time  budgeted;  or  3)  best  available  estimate  of  hours 
spent.   To  be  very  accurate,  comprehensive  time  sheets  should  be  kept 
by  all  personnel  and  others  involved  in  case/outbreak  surveillance 
and  investigation.   The  administrative  costs  should  be  the  fnumber 
of  hours)  times  (salary  plus  fringe  benefits)  for  each  category. 
Other  administrative  costs  may  be  added  if  necessary. 

2.  Supplies 

This  category  includes  al 1  supplies  (lab  and  OPC)  used  for  each  patient. 
Although  the  supplies  cost  could  be  determined  either  by  dividing  the  total  yearly 
supplies  cost  by  the  number  of  GC  patients  per  year,  or  by  costing  each  supply 
used  for  each  patient,  the  latter  method  is  more  accurate.   Using  the  second 
method,  figure  the  cost  of  each  supply  and  multiply  by  the  number  needed  by  each 
patient  and  then  multiply  that  total  by  the  number  of  patients  who  fit  into 
Column  A  and  Column  B. 

7>.      Contact  Investigation 

The  "GC  Contact  Cost  Record"  can  be  used  to  find  the  exact  time  spent  on  each 
contact  investigation,  but  be  sure  to  include  all  time  --  phone,  field,  consulting, 
professional  reading,  etc.   The  standard  per  diem  reimbursement  figure  can  be 
used  to  figure  mileage  costs. 

4.   Overhead 


The  Nursing  Overhead  category  is  designed  to  allocate  the  building,  ma  iiit  cu.->r.co , 
equipment,  and  departmental  administration  costs  as  part  of  the  cost  of  a  nursing 
program.   To  find  the  percentage  figure,  refer  to  the  liepartment  Overhead  Cost 
Sheet  and  multiply  all  program  personnel  costs  (including  fringe)  times  the  over- 
head percentage  to  get  GC  i^rogram  overliead  costs. 


'['raining.  Books,  Periodical 


Include  only  costs  sjiccj^fic  to  the  GC  program.   Costs  whicl 
!)e  allocated  to  the  I'cncral  overhead  (see  Peiia  rt  meat  Overheat. 
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OVEKHt:AD 
th  Ocpartment  Cost.  Analysis 


(h:ei'hi'.ad  in    j  .*'•"''  -'  iosiyned   to  calculate   the    total   costs   of  admin- 
is  ti.'ring  a  pr-'.jram.       !t  ahould  be  noted   that  overhead   ir,   an  estimation 
of  the  he^.i!  th  dcpaj'incnt  's  n.'ibv.inistration  of  all  deparonent  programs, 
■  ill  of  uhich    ivcrlap;   h0nae ,    the  need  for  an  overhead  figure. 


To  t  a  1  Admin  istrat  i  ve  Sal  a  lie. 

Thi>.  means  salaries  plus  appropriate  yearly  fringe  benefits  and  n>erit  raises 
of  only  personnel  involved  in  the  yeneral  admi  n  i  s  t  ra  l_  ion  of,  the  health  department. 
(Other  personnel  niay  be  added  if  other  departments  are  organized  differently. 
Tor  example,  a  health  department  personnel  director  or  assistant  health  officer 
should  be  added  to  this  category.)   The  receptionist  is  the  person  who  acts  for 
the  entire  health  department,  the  general  office  clerk  (or  a  portion  of  her/his 
salary)  acts  as  vital  statistics  clerk. 

To  talculate  (a),  or  total  administrative  salaries,  ri'ultiply  total  salaries 
(whicli  should  include  yrarl/  raises)  by  yearly  fringe  percentage. 

Othei'  Administrative  Personnel  Expenses 

"Termination  Reserve"  means  those  monies  set  aside  to  pay  vacation  and  sick  pay 
severance  to  employees  who  quit.   "Recruitment"  means  costs  budgeted  for  newspaper 
ads,  printing  and  other  costs  of  filling  vacant  positions.   "Conferences  and 
Meetings"  refers  to  those  of  general  interest  to  health  administration  and  not 
applicable  to  a  specific  program,   "Training"  means  general  mangement  or 
administrative  training,  not  that  attributable  to  a  specific  program.   The  "Books 
and  Periodicals"  category  includes  general  health  planning,  public  health,  and 
management  materials  of  general  interest  and  not  attributable  to  a  specific 
program.   "Travel"  means  genera!  health  department  trips  and  excludes  travel  for 
specific  programs  or  conference  travel  (to  be  included  under  "Conferences  and 
Meetings").   Blanks  are  provided  for  other  categories  specific  to  the  general 
administration  of  a  health  department.   Add  alt  these  categories  to  get  Total 
Administrative  Personnel  fxpenses  (b). 

Other  Administrative  Expenses 

Expenses  in  this  category  are  those  which  are  general  to  the  running  of  an 
agency.   Since  it  is  virtually  impossible  to  split  out  the  number  of  pencils, 
pieces  of  paper  and  the  like  used  by  one  program  or  activity,  it  is  a  good  deal 
easier  to  Include  these  as  a  total  category  and  be  able  to  easily  allocate  them 
in  the  department  overhead  computation.   (The  only  exception  to  this  would  be 
grants  where  administrative  expenses  are  each  listed  and  funded  separately  and 
should  be  allocated  as  si/ch.)   Office  supplies,  copies  and  printing,  postage, 
office  equipment  and  phone  are  total  costs  per  year  for  the  whole  department 
excepting  grant  allocations.   Interest  on  warrhnts  Is  Interest  paid  on  monies 
borrowed  from  a  bank  to  cover  current  department  operating  expenses  (if  applicable). 
Other  administrative  expenses  should  be  included  in  this  category  if  they  are 
attributable  to  the  general  operation  of  a  department.   (Note:   It  is  rnore  accurate 
and  easier  to  charge  vehicle  expenses  to  the  program  which  uses  them  on  a  cents- 
per-mile  basis.   It  is  also  a  good  deal  nrare  difficult  to  charge  phone,  office 
space  and  the  like  out  on  a  prog  ram-by- program  basis.) 

Building  and  Maintenance 

Housing  costs  are  to  be  Included  in  the  overhead  computation  because  of  the 
difficulty  of  allocating  square  foot  ages ,  utilities,  phones ,  etc.,  to  each  program 
or  activity.   This  category  should  cover  all  housing  expenses  of  the  department 
and  laboratory. 


This  category  should  include  costs  of  routine 
depreciation  on  capital,  or  other  similar  items. 
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The  purpose  of  this  coot  worksheet  ic    to  provide  a   "for'rrula"   t.n  he. 
used  to  determine   the  overhead,   or   "cost  of  doing  husinasr. ," 
on  a  pevcent&je  basis  so   tht:it  overherid  costs  can  he  fairl;.    -.llooatcd 
to  each  p'lrticu! 21'  health  df.pavttrient  vr-irjrcjr,. 
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''lb,    etc. 


b.    M.iituen.ince 


5.   Other  Ov 


rhead  Expenses 


_bui Iding  and 
maintenance 


_other  expcn:,e' 


TOTAk  OVERHEAD  COSTS  = 


Overhead  Computation 


STD  Information-Time  &  Audience  Card 


PHN/Hltin.  Ed. 


Date  of  Presentation: 

Group: 

Number : 


"''fcrsonnel  Time 

a.  Research  or  data  collection     : 

b.  Phoning  and  meeting  arragements     : 

Cost 
a  X  (sal  +  fringe) 

b  X  (sal  +  fringe) 

c.  Actual  session     : 

c  X  (sal  +  fringe) 

d.  Fo! lowup      : 

d  X  (sal  +  fringe) 

e.  Other     : 

e  X  (sal  +  fringe) 

+           +          = 

personnel    /o   program    /q  dept. 

costs       overhead     overhead    TOTAL 

Mater  ia 1 s : 


Mi  I eage : 


Total   $ 
Total   $ 


"sed  5/81 
PHN/Hlth.  Ed. 


TOTAL  COST       | 
Cost/Part  ic  i  pant 


STD  Information-Time  &  Audience  Card 

Date  of  Presentation: 

Group:    


Personnel  Time 

a.  Research  or  data  collection 

b.  Phoning  and  meeting  arrangements 

c.  Actual  session     : 

d .  Pol lowup     : 

e.  Other     : 


Cost 


a  X  (sal  +  fringe) 

b  X  (sal  +  fringe) 

c  X  (sal  +  fringe) 

d  X  (sal  +  fringe) 

e  X  (sal  +  fringe) 


personnel  %   program  %   dept. 
costs      overhead   overhead 


TOTAL 


Mater lal  s  : 


'J 


leage: 


Total  $_ 
Total  $ 


Comments : 
Revised  5/8 1 
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TOTAL  COST       \^ 
Cost/Participant  I 
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User  Guide 
STD  INFORMATION-TIME  &  AUDIENCE  CARD 


Personnel 

Health  Department  staff  members  (nurses,  health  educators,  etc.) 
When 

Whenever  giving  STD  information  to  a  group  such  as  students,  teachers,  etc. 
Why 

To  determine  the  cost  of  disseminating  STD  information,  to  determine  how  many 
were  in  the  audiences  and  to  determine  what  type  of  group  they  were.  The  data 
will  be  used  in  program  planning. 

How 

The  form  must  be  completed  starting  from  the  time  a  staff  member  is  asked 
(or  assigned)  to  address  a  group  about  STD.  The  form  must  be  filled  in  completely 
with  time  in  10  minutes  increments. 

When  the  session  is  completed  and  all  follow-up  is  concluded,  then  the  form  is 
to  be  turned  in  to  the  Research  Unit. 


/;,F 


STD  Infor-mation-Time  &  Audience  Card 


X 


Time  Spent 

a.  Research  or  data    y 
collection  hr  :  KJt^' 

b.  Phoning  and  meeting 
arrangements  ^r.:  g^/'/U'^ 

c.  Actual   sess1on_hrLJ_  M./^.^ 

d .  Foil ow- up    Iai/*>  :    i»i/>t.*^ 


Date  of  Presentation         ^-^/-/<g 
To:     ^^  <^-LG.JjU      Oj^lLu     ^Zt 

umber:         ^fl 


Chst   (wUthr  filled  in  bu  iU^i^era'c-h   linii) 


'V 


-) 


User  Guide 
STD  INFORMATION-TIME  &  AUDIENCE  CARD 


Personnel 

Health  Department  staff  members  (nurses,  health  educators,  etc.) 
When 

Whenever  giving  STD  information  to  a  group  such  as  students,  teachers,  etc. 
Why 

To  determine  the  cost  of  disseminating  STD  information,  to  determine  how  many 
were  in  the  audiences  and  to  determine  what  type  of  group  they  were.  The  data 
will  be  used  in  program  planning. 

How 

The  form  must  be  completed  starting  from  the  time  a  staff  member  is  asked 
(or  assigned)  to  address  a  group  about  STD.  The  form  must  be  filled  in  completely 
with  time  in  10  minutes  increments. 

When  the  session  is  completed  and  all  follow-up  is  concluded,  then  the  form  is 
to  be  turned  in  to  the  Research  Unit. 
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STD  Information-Time  &  Audience  Card 

.1.  JUl___ 


Date  of  Presentation    c^-JZ-^O 


yHJL^ 


42^ 


^-^LeSUxJ 


Time  Spent 

a.  Research  or  data    ^ 
collection  (^r  :  K'h^- 

h.  Phoning  and  meeting 

arrangements  V\r,:  t^ ', tj"*^ 

c.  Actual  session  hA  :  M/rt.^ 

d .  Fo  1 1  ow - u p    int^.   :    mI*^^ 


%jmher:  -       /t,S 


Cdst   (wilTbr  fi.llcd  in  hu  Riuirarch   Ih>i1) 


V 


U  U^     lO  twin,  ^HinlAvtuvi  4  (0   K.;^.  ;^t6rv/«^/) 


,.  (I 


_  ( 


(;C  Contact  Cost  l^ecord 


nC  Clontact  Cost  Record 


" .  phone 

~  i 

b.  field 
m  i.  les 

c.  other: 


'-a  ted 


a.  phont 


b.  field 
miles 

c.  other: 


located 
not   locate:. 


_nitial: 


date 


date 


GC  Contact  Cost  Record 


GC  Contact  Cost  Record 


phone 

a. 

b. 
c. 

phone 

[_]  located 

1 1   Lucaiea 

field 

[n  not   located 

i     1  not   located 

field 

miles 

miles 

other: 

ther: 

n  i  1 1  a  1 ; 


date 


GC  Contact  Cost  Record 


GC  Contact  Cost  Record 


a.  phone 


b.  field  _ 
m  lies 


JP 


ther: 


r_|  located 

I j  not    located. 


a.  phone 


b.  field 

m  lies 

c.  other: 


located 
not   located 


date 


\   R_ 


date 


t- 
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User  Cauide 


G  C  CONTACT  COST  RECORD 


Personnel 

Outpatient  Clinic  nurses,  state  field  epidemiologist,  others  as  needed. 

When 

Use  when  investigating  all  gonorrhea  contacts. 

Why 

To  help  to  determine  time  spent  by  nursing  and  epidemiology  personnel 
and  to  determine  outcome  (located  or  not). 

Procedure 

Each  time  a  gonorrhea  patient  refers  a  contact,  a  "GC  Contact  Cost  Record' 
is  to  be  completed  by  the  personnel  conducting  the  investigation.  Use  one 
record  per  contact  cited  and  break  time  down  into  10  minute  intervals. 


IC  Contact  Cost  Record 


ited 
locat 

.          ,('   )           l^not 

od 

.  ph 


b .      (i  c  kl 

in  i  1  or>  '  ■■  .,        "'-^ 

'fiy^3'  .^p?^ tL . 


-\,..' 


/J<^ 


date 


n-i['%[ 


There  is  room  on  the  y^ecord  for  three  phone  tries,  time  spent  in  the  field  and 
miles  traveled  by  the  investigator.  The  category  labeled  "other"  can  be  used  for 
explanations  or  other  time  spent. 

Finally,  check  the  "located"  or  "not  located"  box.  Turn  in  completed  form  to 
Research  Unit. 


GONORRHEA   CONTACT 

Program  Cost  Analysi  s 

The  purpose  of  this  aost  analysis  is   to  provide  a  formula   to 
determine  the  costs  to  the  health  department  of  providing 
gonorrhea  aontaat  investigation  and  surveillance. 


PERSONNEL   COSTS 

a.      Phone    Investigation:    RN   time/contact  x    (salary  +  fringe)      ,  Ho 

X  #  of  contacts   phoned  (lS°lo  0^  m  COtli^H  re^<W  p),o»vt  inv.)      >IQZ 


Field    Investigation:    RN  time/contact  x    (salary  +  fringe) 
X  #  of  contacts /ZS-^o  otoU  (U}nJttUt> lUfivu,  dtXd  i(Hr<5f-.  c/i) 

iUitc  Ou^.  oeU.  -i-  ll.i>z    Pri  (»  /!,%)  s  ^7.3f! 
0theV'^^''''^'^'^3-W5 


l45 
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NURSING  DIVISION  ADMINISTRATIVE  COSTS 

a.  Nursing   Director 

(iZ.Ui/LjV)  lis    \<,\yrY\^)~.$jgCi 

b.  Nursing  Supervisor       i 

c.  Clerical  Support  (^f?**^/^- 


a.   j^  mi  ./contact  x.2^t/m\.    per  fie 


investigation 


^.UlrviA   )^  ^b'^Zh' 


2fc 


iir 


.2k. 


5.  OVERHEAD:   3,0^  x  tot.  salary  +  fringe  x 

6.  TRAINING,  BOOKS,  ETC. 


Z5^ 


5/81  jsh 


TOTAL  PROGRAM  COST 


TOTAL  PROGRAM  COST 
PER  CONTACT 


1^/056 


;./6 


tlbie:  6^Mt  ^  pccti€(it  cA/t(W  GC  [pTikeZ  UhjL 
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Section  ^4 
outcome  measures  —  repeators  and  contact  followup 

Results  -  Based  on  Missoula's  Outpatient  records,  30'l  of  patients  reported  they 
had  a  STD  before  (repeators).   Missoula  did  not  meet  its  goal  of  reducing  STD 
repeaters  in  1980.   Thirty-five  percent  of  the  Outpatient  records  showed  that 
all  of  the  patients'  listed  contacts  were  followed-up.   Of  ^')5  patients  who  were 
examined  for  gonorrhea,  20'?,  were  positive.   Fifty-four  percent  of  the  records 
showed  patients  passed  their  test-of-cure,  while  hj%   of  the  records  do  not  show 
evidence  the  patient  had  or  passed  their  test-of-cure.   (See  full  report  page  U .k) 

Discussion  -  The  outcome  measures  in  this  section  are  easy  to  gather  and  clear- 
cut.   Minimum  recommendations  for  gathering  outcome  measures  are: 

1.  Percentage  of  Contacts  Completely  Investigated/Treated  ~-  A  particularly 
important  outcome  because  public  health's  goal  is  to  interrupt  the 
chain  of  STD  transmission. 

2.  Percentage  of  Repeators  —Gives  an  indication  of  results  of  patient 
education . 

The  Missoula  Health  Department  keeps  data  on  patients'  age,  marital  status, 
employment,  type  of  earlier  STD  incidence  and  treatment.   This  information  is 
a  great  help  with  understanding  patient  characteristics  and  designing  marketing 
and  public  service  announcements.   In  addition,  changes  in  the  ages  of  patients 
can  be  a  measure  of  effectiveness  of  talks  to  high  school  students  — more 
emphasis  on  student  education  should  increase  the  proportion  of  patients  who 
are    in  the  15~19  years  of  age  category. 

Methodology  -   The  Gonorrhea  Statistics  sheet  (page  k.2)   can  be  designed  to 
gather  information  from  your  patient  records  or  from  other  convenient  sources. 
We  recommend   dividing   information  into  five  categories  as  shown:  total,  female 
patients  -  negative,  female  patients  -  positive,  male  patients  -  negative,  and 
male  patients  -  positive.   This  way,  your  results  can  be  easily  analyzed  to  look 
for  significant  differences  between  categories. 

There  are  two  ways  to  measure  whether  or  not  contacts  are  completely  investigated. 

(1)  For  each  patient  record,  if  all  contacts  were  resolved,  then  that  record 
v;as  marked  as  "All  Contacts  Diagnosed."   If  one  of  several  contacts  was  not 
resolved,  then  the  record  was  put  into  "Not  All  Contacts  Diagnosed"  or   an  in- 
complete outcome  because  one  or  more  contacts  with  a  possible  sexually  transmitted 
disease  could  still  be  transmitting  a  disease.   Missoula  used  this  method. 

(2)  Another  way  would  be  lo  look  at  each  contact  separately  and  put  each  into  a 
"Yes,  resolved"  or  "Mo,   not  resolved"  category.   This  would  give  you  information 
on  how  many  individual  contacts  were  not  resolved,  unlike  Missoula's  method  (l) 
which  shows  how  many  individual  patient's  contacts  were  not  all  resolved. 
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Outnatient.  c'lirric   (.(jnorrhea  Outcome   Statistics,   Jan. -Dec.    1980. 


Here  are  your  calendar  ye.jr   1980  Outi'atient   Clinic   statistics.      They  con^e   from   the 
yellov^   "STD  Report"    fori;)   the   clinic   nurses   fill    out   for  each   qonorrhea    (GC) 
patient.      Tlie    followinn    is   a   siiort   suniiiiary  of   the    finciinqs.      Attached   is   the   complete 
list  of  statistics  on   the   iM'oixi^.ed  nf^w  data    forii;. 


RLPORT 
OPC   Gonorrhea   Patients 


Aoe:      Female   patients  who   ,vfM'e   found  positive   for  (iC  are   general  ly  younqer   than 
their  male   coun  terimrts .      Most   GC   patients   .live   between   ages    16  and   25. 

!1'^LLI.-'i1  r:lAtj^l.-      Women   i3dtients    found   to   have   GC  are   three   tinies   n'ore    likely    to 
be  married   than  men   [lositive   for  GC .        Divorced  men  examined   for  GC  are 
appr'oximately   two    tiiiK'S  more   likely   to   have  a   disease   than   divorced  woiren. 
Analysis   shows   94     of  tiie    GC    Records   had  marital    status   listed. 

_Lnj_p_lovment:      Women    found   positive   for  GC  are  much   less    likely   to   be  workinn 

full-time   than  ei  tfiec  ii;ale   patients  with   GC  or   the   total    patient  population. 
Men   dfi.!   sliiihtly  \:\nrr   likf^ly   to   be   unemployed   (of   those  men    found   to   be 
positive   for  GC).      Wtdion   [latients  with   GC   are  much  more   likely   to  be   students 
Analysis   sh,ows    ib     of   the  GC   Records   had  employment  status   listed. 

"'I'^y'i^  y 01'   •-_■>' f'r  •13'^   3nj/    type  of  VD  be_fovvj?":      YES:      Thirty   percent  of  all    patients 
reported   they   fiad  a,   SID  l^efore.      Nineteen   percent  of  women  who  were   neoative 
forSTDsaid   thrry   had  a   STD  t)efore,   contrasting  with    the   total    average  of 
30'^.      Only   seven  of   thic    135   patients  who   reported   they'd  had  a   STD  before 
were    treated  at   the  Missoula   City-County   Health   Department.      Analysis   shows 
85",  of    the   STD  Records   had  answers    to   the  question   listed. 


MISSOULA  CIIY-COUMIY  HEALW  DEPARTMENT 

.301   VJLSJ  AUOEIR   .STREET      /^lISSaiLA,^!  57601 
IILrPHONL     721-5700 
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Memoranduin 
Crystal    Day 
OPC  Statistics 
Page  2 

Conta_c_t_s,    !\f}co_rded  and  FoiU)vvX}d  i][i:     Of  those  patients   found  to  be  positive   for 

GC,   women'  patients  wore  generally  more  likely  to  report  more   than  one  contact. 
Approximately   14"  of  the  GC  [Records   showed  zero  contacts   listed. 

All    ContauLs   E_x_a!iiined ,    ift.'HiC'i:      Thirty-five   peroMit   of  all    GC  Records   showed   that 
t>ar))   cotitact    list(;d   iiad  hoen   located,   exan'in(;d.    and,    if  necessary,    treat(!r!. 
The   '^eniainint!  6b     of   the   records   had  one  or  more  contacts  who  were  not 
shown   to  have  beer,   (1)    located,    {?)   examined,    (3)    treated,   or  (4)   no  contacts 
were    listed   fo>'  a   ;i;)sitive   GC   patient. 


General 


20'    of  dll    STf)  patients    ar( 
(22'.:   -  male;    16V   -    <"cma  1  e ) 


9   in   11R0,   t!ie  OPC  saw  an  averaoe  of  37  GC  patients   per  month  and 
an  avera(;e  of  7.4  ;)ositive  GC  patients   per  month 

«  54"  of  patients  passed   their  tests-of-cure  the  first  time;    1  record 
(of  89)   showed  the  patient  did  not  pass   their  test-of-cure  until   a 
secoiid  try;   and  47,':;  of  r-ecords  do  not  show  evidence   that  the  patient 
had  or  passed  their  tes t-of-cures 

•   there  were  445  STD  records   in   1980,   N  -   445. 

Female  -  ^  139 

Feiivale  +  =  27 

Male  -       -  217 

Mole  +       -  62 

445 

9  tne  OPC  sees   aptiroximately  34''  of  the  reported  GC  cases   in   the  county 
(244  cases  were  rejjorted   in   1980  for  Missoula  County;   source  DHES.) 


1   have  enjoyed  compilin'i  these  statistics  and  [jresentino   them  to  you.     Please 
feel    free  to  moke  any  coinmonts  about   their  usefulness,   changes  you  would  like 
to  see   in  format  or  content  and  criticisms  about  the   information. 

Please  also  review  tlu^   '^ew"   v.s.    the   "old"   GC  Outcome  [Report  forms  and  advise 
which  you  prefer,    i.e.,   whichi  o'ves   you  the  best  manaoeiKent  data. 
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MISSOULA  CITY- COUNTY 
HEALTH  DEPARTMENT 

301  West  Alder  •    Missoula.  Montana  59802  .    Ph.  (406)  721-5700 


TO :  Dennis  Lang  .  p.,  J^ 


FROM:   Susan  Plath  cA-t^ 
DATE:  May  19,  1982 

RE:   Outpatient  Care  Clinic,  STD  Outcome  Statistics,  July  1981  -  April  1982 

Each  year  STD  outcome  statistics  are  compiled.  Last  year's  results  were  for  the 
calendar  year.   This  year,  data  was  compiled  on  a  fiscal  year  basis.   In  the 
future,  compiling  statistics  on  a  fiscal  year  basis  will  allow  for  comparisons. 

These  results  allow  us  to  look  at  the  repeator  percentage  and  compare  it  to  the 
goal  set  each  year.   They  will  also  help  us  in  our  public  relations  efforts 
(marketing  and  public  service  announcements). 

The  information  is  gathered  from  the  blue  and  yellow  "STD  Report"  form  the  clinic 
nurses  complete  on  each  STD  patient.   A  total  of  250  charts  were  studied,  comprising 
the  first  ten  months  of  Fiscal  Year  1982.   If  these  statistics  are  used,  the 
last  two  months'  data  should  be  compiled  and  added  to  this  report. 

Statistics  can  be  presented  in  an  aggregate  or  segregate  manner.   The  results  can 
vary,  depending  on  which  method  is  used.   Both  are  presented  in  this  report. 
Study  the  findings  and  decide  which  method  provides  the  most  beneficial  information. 
This  will  rieduce  the  computational  and  report  writing  time. 

OPCC-STD  Patient  Report 


AGE 


Aggregate; 


Segregate: 


In  general,  the  age  of  STD  patients  is  21-25  (27%)  or  26-30  (21%) 
Of  these  STD  patients,  women  were  younger  than  the  men.  There  were 
only  4  charts,  or  1.6%,  that  did  not  have  this  information  recorded. 

The  majority  of  STD  positive  females  were  21-25  years  old  (41%)  or 
16-20  (28%),  while  the  positive  males  were  21-25  (33%),  26-30  (26%), 
or  31-35  (26%)  years  old.   The  positive  women  tended  to  be  younger 
than  their  male  counterparts. 


MARITAL  STATUS 

Aggregate:   STD  patients  report  they  are  single  (70.4%).   Past  data  showed 
patients  reported  they  were  single. 

Segregate:   The  STD  positive  patients  also  reported  they  were  single.   In  the 

past  STD  positive  women  were  three  times  more  likely  to  be  married. 
For  the  first  10  months  of  FY  82,  the  percentage  of  positive  married 
people  were  about  the  same  (+  females  4%,  +  males  6%;  -females  18%, 
-males  15%). 


EMPLOYMENT 
Aggregate: 

Segregate: 


On  the  whole,  STD  patients  are  either  employed  full-time  (41.2%) 
or  the  other  extreme,  unemployed  (38%). 

STD  positive  males  were  twice  as  likely  to  have  a  full-time  job  (38%) 
when  compared  to  positive  females  (18%).   The  reverse  was  also  true, 
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positive  females  were  more  likely  to  be  unemployed  (59%)  than  their 
male  counterparts  (38%). 

STD  REPEATOR 

Aggregate:   The  majority  of  STD  patients  had  not  had  VD  before  (58.8%),  although 
those  who  had  a  VD  before  do  not  lag  far  behind  (33.6%).  Many  of 
those  reporting  a  VD  before,  also  mentioned  they  came  to  this  health 
department  the  first  time.   There  were  19  charts  (7.6%)  that  did  not 
have  a  response  to  this  question. 

Segregate;   The  positive  STD's  reported- this  was  the  first  time  they  had  contacted 
VD.  Positive  men  were  more  likely  to  have  had  a  STD  before, 
41.2%  compared  to  27.3%  for  positive  women.  This  trend  was  consistent 
for  negative  STD  patients. 

NUMBER  OF  CONTACTS  RECORDED  (Positive  patients  only) 

Aggregate:   Patients  generally  reported  one  contact  (55.3%),  with  17.9%  reporting 
two  contacts.   Approximately  18%  of  the  records  were  not  complete. 

Segregate:   The  majority  of  women  (68.2%)  reported  one  contact.   Less  than  half 
the  men  reported  one  contact  (47.1%).   Men  were  more  likely  to  have 
two  or  more  contacts  than  women.   The  records  on     18%  ofthe.'.men 
■  and'iwomen  were  incomplete, 

ALL  CONTACTS  EXAMINED  AND  TREATED 


Aggregate:   Sixty-two  percent  (62%)  of  the  records  showed  each  listed  contact 

was  located,  examined,  and,  if  necessary,  treated.   There  were  34%  of 
the  records  which  showed  one  or  more  contacts  who  had  not  been 
(1)  located,  (2)  examined,  (3)  treated,  or  (4)  contacts  were  not 
listed.   Approximately  4%  of  the  records  showed  the  contacts  were 
referred  to  another  agency  for  followup  (State  Field  Epidemiologist). 

Segregate:   Over  fifty  percent  of  the  positive  STD  patients'  contacts  were  located/ 
examined/ treated.   In  both  males  and  females,  18%  of  the  records  did 
not  contain  this  information.   Twenty-three  percent  (23%)  of  the 
positive  female  contacts  were  not  treated,  examined,  and/or  located; 
12%  of  the  positive  male  cases  did  not  meet  these  guidelines. 

GENERAL  STATISTICS 


•  22%  of  all  STD  patients  were  found  positive 
(20%  -  male;  27%  -  female) 

•  for  the  10  months  (July-April) ,  the  OPCC  saw  an  average  of  25 

STD  patients  per  month  and  an  average  of  5.6  positive  STD  patients 

per  month 

•  there  were  250  STD  records  for  the  10  month  period  studied 

female  -  =  61 
female  +  =  22 
male  -  =133 
male  +   =34 
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The  statistics  took  approximately  two  hours  to  collect  and  about  6  hours  to  calculate 
and  write.  Once  you  decide  on  aggregate  or  segregate  data,  the  calculating  and 
writing  time  will  be  reduced. 

If  there  is  limited  time  available  for  research  work,  you  may  want  to  consider 
the  usefulness  of  this  data.   Are  you  using  any  parts  of  it  for  management 
purposes?  Is  this  information  helping  you  make  time  or  cost  allocations? 
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Section  5 
year  to  year  changes  in  county  gonorrhea  rates 

Results  -  Missoula  County's  gonorrhea  rate  has  steadily  dropped  from  492  (1977) 
to  338  (1980).   The  rate's  decrease  since  1978  has  closely  followed  Montana's 
gonorrhea  incidence  rate.   If  this  trend  continues,  budgets  for  gonorrhea 
surveillance  can  also  continue  to  drop,  freeing  resources  for  other  programs. 

Discussion  -  Although  the  gonorrhea  incidence  rate  is  not  an  exact  measure  of 
public  health  effectiveness,  it  is  an  indicator.   Increases  in  the  rate  can  be 
an  alert  that  more  emphasis  is  needed  on  the  gonorrhea  program,  especially  if 
an  increase  occurs  in  county  incidence  at  the  same  time  as  a  steady  or  decreasing 
Montana  rate. 

A  more  effective  communicable  disease  reporting  system  (Communicable  Disease 
Users'  Guide,  Section  1)  will  probably  increase  the  gonorrhea  rate  simply  because 
more  cases  will  be  reported.   It  is  very  important  to  carefully  analyze  changes  in 
the  gonorrhea  rate  to  see  if  the  increase  is  a  true  indication  of  increased 
incidence,  a  result  of  better  reporting,  or  perhaps  a  temporary  increase  caused 
by  a  transient  population. 

Methodology  -  The  State  Preventive  Health  Services  Bureau  will  give  you  yearly 
gonorrhea  rates  ("Gonorrhea  Incidence  by  County")  beginning  with  I969.   The  rate 
is  calculated  by: 

.  .  Gonorrhea 
county  incidence      „  ,„-  „„„   ■   .  , 
X  00.000  =  ncidence  Rate 


county  estimated  population 
Rates  are  easily  graphed  and  updated  yearly. 
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GONORRHEA  INCIDENCE  GRAPH 
MISSOULA  COUNTY  AND  MONTANA 

The  data  for  this  graph  is  collected  from  "Gonorrhea  Incidence  by  County"  which 
is  kept  by  Bruce  DeSonia,  State  Field  Epidemiologist.   If  Bruce  does  not  have 
the  table,  call  Valinda  Holmes,  Communicable  Disease  Clerk,  State  Preventive 
Health  Services  (449-2645). 

1.  To  calculate  the  disease  incidence  rate  (see  Attachment  1): 

Missoula  Incidence  _  Missoula  Incidence 

Rate  per  100,000    "  Missoula's  Estimated  Population    100,000 

Example:   1979  figures 

Missoula  Incidence  _  275  Incidence ^   _ 

Rate  per  100,000       69,700  Estimated  Population    ^00,000  - 

Montana  Incidence   _      Montana  Incidence  (total)     ^„„  ^__ 
per  100,000  Montana's  Estimated  Population 

Example:   1979  figures 

Montana  Incidence   ^  1,934  Incidence -^  -^-  ^  „,  , 

per  100,000  785,000  Estimated  Population    iuu,uuu 

2.  Rounding  of  Numbers:   when  rounding  off  a  5,  always  round  to  the  even  value. 
Example:   3.5  =  4        4.5  =  4 

3.  An  estimated  population  is  used  by  the  State  Preventive  Health  Services  Division. 
The  population  is  taken  from  the  Census  figures,  however;  they  will  estimate  a 
new  figure  every  four  years  -  use  the  State's  population.   This  will  give 
consistent  and  comparable  year-to-year  data. 

4.  Montana's  population  does  not  include  the  Military  (Great  Falls).   Double 
check  this  every  year.   If  they  begin  reporting  the  Military  in  the  State's 
GC  Incidence,  it  will  need  to  be  noted  on  the  graph  or_  the  Military  figures 
subtracted  from  the  Incidence  and  Military  population  subtracted  from  the 
estimated  population. 
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SECTION    6 

SEXUALLY   TRANSMITTED  DISEASE  MODEL 
Evaluation  Plan 

hitroducticm 

Public   health  departments    in  Montana   have  been  actively  working   to  control 
sexually   transmitted  diseases    (STD)   since  1962.      There  are  serious   health 
consequences   of  qonorrhea,   syphilis,   herpes,   chancroid  and   the  other  sexually 
transmitted  diseases.      Direct  costs    (control,    treatment,   and  follow-up)   and 
indirect  costs    (lost  productivity  to  both   society  and   patients)   are  high. 
For   instance,    in  1976   it  was   estimated   that  gonorrhea   complications    in  women 
included  175,000  hospital    admissions   totaling  1.2  million  hospital    days.^1 
Further,   1976  approximations  show  that  $60  million  of  tax  monies  are  spent  each 
year  for  the  institutional   care  of  patients  with  syphilitic  psychosis. 

Montana  statistics   show  a   steadily  increasing  number  of  cases  of  gonorrhea 
over   the  past  decade   from  473  reported  cases   in   1968   to  2126  reported  cases   in 
1978. 

It  is   generally  agreed   that   the  role  of  public   health   in  dealing  with   the 
problem  of  STD  is    "PREVENTION  AND  CONTROL  OF  THE   INCIDENCE  AND  SPREAD  OF  SEXUALLY 
TRANSMITTED  DISEASES."     Specifically,    public  health   programs  are  concerned  with 
minimizing   the  spread  of  STD,   education  of  the  public  and  health   professionals, 
following-up  cases,   contact  tracing,   early  case  findina,   reducing   the  medical 
complications  of  STD,   reducina   re-infection   rates   and  operating  STD  programs 
as  effectively  and  efficiently  as   possible. 

Public   health  departments    in  Montana   have   long   been   interested   in  evaluating 
their  efforts.      Their  desire   for  qualitative  and  quantitative  data  on  which 
to  base  their  program  planning  and  to  allocate  resources  was  formalized  with   the 
approval    of  a   two-year  research   evaluation  grant  between   the  St^te  Department  of 
Health  and   Environmental    Sciences   and   the  Missoula   City-County  Health   Department, 
contractor  for   the  evaluation   project.      The  Missoula   Health  Department, 
responsible  for  developing   evaluation  models   for  eight  public   health   programs, 
will    develop  and   test  evaluation  models    in  Missoula,   revise  them  as   necessary, 
and   then  distribute   "user  guides"    to   local    and   the  State  Health   Department  for 
their  use. 
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"^   Literature  Search 

A  search  was  conducted  to  find  existing  work  on  evaluation  of  public  health 
STD  programs.   In  addition,  health  professionals  and  experts  in  the  field  of 
sexually  transmitted  disease  containment  were  consulted.  A  brief  review  of  the 
results  are  as  follows: 


S.  Perfr'ament,  K.  Ovcrj 
:'>cxua  I  iij  'h'uyir.m'  L  ted  /■' / 
Default,'.'"' 


'/■/,  "Which  Study  of  new  STD  eases  attending 

'<<■;;(■.■:  Patients  a  clinic  in  Lomlon  which  showed 

that  the  clinic  influenced  attitudes 
which   the  authors  felt  may  influence 
attendance.      They  believe,    hou)ever, 
that  these  results  are  related  to 
social  class   or  previous  attendance 
at  a  clinic. 


A.    Hinrian,    "Evaluatioyi.  of    "joyiorrhea 
Control  Efforts" 


Author  feels   that   the  most  important 
aspects  of  gonorrhea  control  are 
(1)   provision  of  diagnostic  and 
treatment  facilities  and   (2)    in- 
vestigation of  cases.      He  feels 
that  culturing  for  gonorrhea  has 
played  a  sm.aller  role  and  imjjacts 
of  education  have  been  impossible 
to  measure. 


J.    Hayes,    J.    Littlefield,    "VD 
Knowledge  in  High  School  Seniors 


Study  of  740  high  school  students 
which  shoiJed  a  43%  correct  response 
rate   to  a   test  of  knaoledge  of 
causes  and  origins  of  STD,   symptoms 
and.  control  therapy.      Significant 
differences   existed  with  more 
affluent  schools  scoring  higher. 
Students  know   little  specific 
information  of  houi  STD  spreads, 
techniques  for  medical  diagnosis 
and  the  health  consequences   of 
untreated  STD. 


Journa I  of  Practical  Nursi'ig 
"VD  -   Controlling   the  Spread' 


Cives  statistics   on  incidence 
levels,    clinical  symptoms,    and 
reviews   the  current  four  methods 
used  f:>y  public  health  officials 
to  coyttrol   the  spread  of  STD   — 
gonorrhea  screening,    reactor 
follow-up,    health  education  efforts 
and  contact    tracinn. 
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S.    Jerrick,    "Federal  Efforts 
to  Control  Sexually   Trammiticd 
Disease" 


J.    nloioii,    "A   New  Ai>pr< 
Goriorrh ea  i'))idcmio  lony ' 


h   f>r 


Calls  for  the  federal  govermient 
to  play  a  more  important  role  in 
providing   leadership  a7id  coordina- 
,,tion  for  educational  efforts   on 
STP  and  norc  support   to  behavioral 
research  on  STD  prevention,    trans- 
mission. 

Gives   results   of  interviewing 
approximately  0,600  gonorrhea 
patients   to  determine  relative 
effectiveness  of  identifying 
sex  contacts  and  providing  treat- 
ment for  people  in  gonorrhea 
reservoirs.     Shows   the  most 
effective  category  for  discovering 
untreated  cases   is  interviewing 
m,ale  volunteers  at  a  cost  of  $6.  16 
per  new  case  hr'ought   to   treatment. 
Calls  for  further  study    to  determine 
if  patient  characteristics  are 
factors  in  determining  effectiveness 
and  interviewing  gonorrJiea  patients 
to  discover  new  oases. 

From  this  list  and  conversations  with  experts  and  health  professionals,  it  is 
evident  that  little  work  is  available  to  be  used  as  reference  for  this  evaluation 
project.  This  means  that  quantitative  and  qualitative  evaluation  will  have  to 
come  from  the  systems  designed  in  this  project.  Attempts  will  continue,  however, 
to  use  other  research  as  available. 

Prof essional  Contacts 

Experts  in  the  STD  control  field  were  contacted  by  letter  or  phone  to  review 
the  purpose  of  the  evaluation  project  and  to  ask  for  their  comments  and  suggestions. 

•  Dr.  Martin  Skinner,  Chief  of  the  Preventive  Health  Services 
Bureau,  Montana  State  Department  of  Health  and  Environmental 
Sciences. 

0  Rick  Crankshaw,  Montana  Immunization  Coordinator,  State  Department 
of  Health  and  Environmental  Sciences. 

•  Bruce  DeSonia,  Field  epidemiologist.  State  Department  of  Health 
and  Environmental  Sciences. 

s  K.  Overfield,  University  of  Sussex  and  Department  of 
Genital  Medicine,  England. 
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•  Steven  B.  Tiiacker,  Bureau  of  Epidemiology,  Center  for  Disease 
Control ,  Georgia . 

•  Others,  CDC. 

Local   Health  Department  Administrators 

Don  Pizzini,  Health  Officer  and  Cherry  Travis,   Nursing  Director,   Cascade  City- 
County  Health  Department,   Great  Falls,  Montana. 

Cited  particular  interest  in  incidence  of  STD  among  teens, 
and  the  efficacy  of  educational   efforts. 

Bob  Johnson,   Health  Officer  and  Shirley  McGuire,   Nursing  Director,   Lewis   and 
Clark  Health  Department,   Helena,   Montana. 

Would   like   information  on  cost   (diagnosis,    treatment  and 
follow-up) . 

David   Feffer,   Health  Officer,   Crystal    Day,   Nursing  Director,   Diana  Anderson, 

RN,  and  Mary  Taylor,   RN,  Missoula  City-County  Heafth  Department,  Missoula,  Montana. 

Reducing   the  number  of  repeators,   neneral    prevention 
and  cost  were  rated  highest. 

Bill   Burke,  Health  Officer,  Silver  Bow  Health  Department,   Butte,   Montana. 

SBHD  refers  STD  patients   to  private  facilities. 

George  Sheckleton,   liealth  Officer  and  Jan  Treml  ,   Nursing  Director,   Yellowstone 
County  Health   Department,   Billings,   Montana. 

Concerns  center  around  outcomes  and  reporting  systems. 

Edward  King,  Health  Officer  and  Jackie  Stonnell,   Nursing  Director,  Gallatin     City- 
County  Health   Department,   Bozeman,   Montana. 

GCCHD  refers   STD  patients   to   private   facilities. 

Bruce  Mclntyre,  Health  Officer  and  Audrey  Gonzales,   Nursing  Director,   Flathead 
City-County  Health   Department,   Kalispell,   Montana. 

Cites   problems  of  transient  STD  population  and   non-compliance 
to  oral   medications. 

Close  communication  will    be  maintained  with  both   local   and  state  health  depart- 
ments  as  well    as  with  experts   as  mentioned.      Further  sources   of  information  and 
help  will    be  sought. 

Work   to  Date 

The  Missoula  Health  Department  has  done  some  preliminary  work  on  determininn 
costs  of  treating  sexually  transmitted  diseases. 
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The  FY  1979  Clinic  Study  showed  the  cost  to  the  health  department  of  providing 
an  STD  initial  exam  as  totaling  S9.84  for  females  and  $9.58  for  males.  This  cost 
includes  supplies,  personnel  time  and  overhead.  The  study  also  placed  the  per- 
centage of  STD  patients  who  did  not  pay  for  services  at  29%.  A  time  study  of 
clinic  users  showed  the  average  time  STD  patients  waited  to  see  a  nurse  was 
22  minutes.  Results  of  this  study  were:  (1)  the  fee  schedule  for  STD  patients 
was  increased  to  more  accurately  reflect  cost  to  the  health  department,  (2)  clinic 
hours  were  changed  to  better  utilize  staff  and  (3)  a  partial  payments  system 
was  instituted.  With  this  work  as  a  basis,  the  Missoula  Health  Department  has 
planned  to  continue  the  data  as  a  time  series  during  FY  1980  and  beyond. 

M'-' thods   of  Proaedurc 


There  are  13  generally  recognized  sexually  transmitted  diseases: 

gonorrhea         nonspecific  urethritis 

syphilis  herpes 

chancroid         condyloma  acuminatum 

donovanosis       mol 1 uscum  contagiosum 

scabies  lymphogranuloma  venereum 

trichomoniasis     pediculosis 

candidiasis 
Gonorrhea  takes  a  good  deal  of  time  by  health  professionals  in  Montana. 
Because  procedures  used  in  diagnosis,  treatment,  and  location  of  contacts  are 
comparable  among  the  diseases,  the  STD  F.valuation  Model  will  use  the  disease 
gonorrhea  as  applicable  for  the  evaluation  model.  The  model  will  be  designed 
so  that  it  can  be  easily  modified  for  use  in  evaluating  other  sexually  transmitted 
diseases  as  needed. 

Established  program  objectives  will  be  used  as  research  objectives.  Meeting 
(or  not  meeting)  the  objectives  then  becomes  the  measure  of  a  programs'  effective- 
ness and  efficiency.   In  other  words,  is  the  program  meeting  the  over-riding 
goal  of  public  health  which  is:   PREVENTION  AND  CONTROL  OF  THE  INCIDENCE  AND 
SPREAD  OF  SEXUALLY  TRANSMITTED  DISEASES. 
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)     Objectives  by  Fiscal  Year  -  1.  To  provide  complete  diagnosis,  treatment,  and 
(MissoulaT"  follow-up  of  all  gonorrhea  patients. 

2.  To  achieve  effective  screening  and  treatment  at 
an  average  cost  of  $15  per  person  who  comes  in 
for  gonorrhea. 

3.  To  locate  and  get  in  to  medical  care  90°/  of 
reported  gonorrhea  contacts  within  72  hours  of 
report  at  a  cost  of  $20  per  contact  cited. 

4.  To  reduce  the  incidence  of  gonorrhea  repeaters 
from  4°/  to  2%  of  total  gonorrhea  patients. 

5.  To  maintain  a  reporting  system  whereby  cases  of 
gonorrhea  are  reported  to  the  health  department 
within  48  hours  of  confirmation. 

6.  To  actively  provide  STD  information  to  the  public 
at  a  cost  to  the  health  department  of  $20  per 
hour. 

7.  To  achieve  a  long-term  decrease  in  the  gonorrhea 
rate  from  517  in  1975  to  346  in  1980. 

Gonorrhea  Evaluation  Description 

For  purpose  of  clarification,  definitions  shall  be  as  follows: 

)  I  patient  =  a  person  who  seeks  medical  care  for  a  disease  or 

symptoms  by  coming  in  to  a  (public)  health  facility. 

I  contact  =  a  person  cited  as  exposed  to  a  disease  by  a  patient(s) 
(note:  contact  becomes  a  patient  only  when  coming 
into  health  facility  for  diagnosis). 

Because  the  general  method  used  by  public  health  in  dealing  with  gonorrhea  is 

to  operate  outpatient  clinics,  the  evaluation  model  is  designed  for  evaluating 

a  STD  clinic  system  staffed  by  public  health  nurses.  The  research  evaluation  will 

1.  Provide  a  data  base  for  planning  and  administrative  decision- 
making. 

2.  Evaluate  STD  programs  for  effectiveness  and  efficiency. 
Evaluation  descriptions  for  each  of  the  seven  research  objectives  will  follow 

the  same  format:  (1)  rationale  for  the  established  objectives  will  be  discussed, 
(2)  methodology  will  be  detailed  and  explained,  and  (3)  use  of  the  data  by 
administrators  will  be  suggested. 


6.6 


1 


STD  Evaluation 
Page  7 

Objective  1.  To  Provide  Complete  Diagnosis,  Treatment  and  Follow-up  of  a11 
G onorrh e_a_  Patients . 

Rationale  -  VJhen  patients  come  to  STD  clinics  it  is  the  accepted,  but  seldom 
quantified,  goal  to  provide  accurate  and  consistent  diagnosis,  effective  treat- 
ment and  complete  follow-up.   In  order  for  public  health  to  measure  its  success, 
mileposts  sucfi  as  this  objective  must  be  established  and  met. 

For  purposes  of  this  objective,  "complete  diagnosis,  treatment  and  follow-up 
of  all  patients"  means  (1)  accurate  diagnosis  so  that  85%  of  patients  who 
actually  have  gonorrhea  are  diagnosed  as  such,  and  (2)  complete  treatment  so 
that  the  patient  is  deemed  to  be  medically  free  from  the  disease  within  a 
generally  accepted  seven  days. 

Methodology  -  Standardized  Sexually  Transmitted  Disease  Procedures  will  be 
developed  as  a  means  of  formalizing  the  STD  detection  and  treatment  process. 
Each  step  will  be  listed  from  first  seeing  a  patient  to  the  test-of-cure  and 
contact  search.  An  outline  form  will  be  utilized  so  that  personnel  will  be 
able  to  use  it  quickly  and  easily.  For  example  -- 

I.  Initial  Visit 

A.  If  patient  says  he/she  has  gonorrhea  or  has  been  referred 
by  contact  then: 

1.  explain  confidentiality 

2.  fill  out  VDRL  form 

Blanks  will  be  left  where  appropriate  (depending  on  laboratory  facilities  or 
reporting  system,  for  instance)  and  users  will  be  able  to  personalize  the 
Procedures  for  their  own  specific  use.  The  final  form  of  the  Procedures  will 
be  a  three-ring  notebook  with  plastic-encased  pages.  Space  will  be  available 
for  addenda  as  the  user  desires. 

To  measure  use  and  effectiveness  of  the  protocols,  peer  review  will  be  utilized. 
The  review  will  track  use  of  each  step  of  the  protocols  with  emphasis  on  con- 
sistency in  dealing  with  gonorrhea  patients. 

In  addition,  a  small  number  of  patients  will  be  interviewed  to  see  if  they  ^.v^ovV^'^' 
felt  they  received  care  as  outlined  in  the  protocols.  ^ 

A  patient  survey  will  be  administered  to  a  statistically  significant  sample 
of  STD  patients  to  determine  what  type  of  person  is  prone  to  get  STD  and  who 
comes  to  a  public  health  clinic  for  help.  The  questionnaire  will  cover: 
sex 
age 
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^  residency  (i.e.,  is  the  patient  a  transient) 

education  (i.e.,  is  the  patient  a  student  and 
from  which  level  of  school) 

contact  or  new  patient 

STD  knowledge/ prevention/attitudes 

Results  from  the  questionnaire  will  show  a  profile  of  average  patients,  their 
levels  of  knowledge  of  spread  of  STD,  its  symptoms  and  prevention. 

A  direct  measure  of  outcome  will  also  be  included  in  measuring  attainment  of 
Objective  1.  Because  the  final  measure  of  diagnosis,  treatment,  and  test-of- 
cure  is  a  disease-free  patient,  statistics  will  also  be  kept  on  the  basis  of: 


patient^does  not  ,  -^  does  not  receive 

I     further  medication 


--^  fai 


return   for  test 

Test-of-cure —  -~^   fails  — : 

— '  oatient  returns   '  •    -->  receives  further   I 

for  test      — i  medication     — j 

--^  field  referral     --^  passes*  '  ---^  pas?! 

needed 

A  running  total  can  then  be  kept  by  quarter  (or  biannual ly  or  yearly)  giving 
the  percent  of  patients  at  each  level  of  the  matrix. 

1.  Patients  passing  test-of-cure  (   )     t   total 
first  time  (    )      % 

second  time  (     )     % 

2.  Patients  not  passing  test-of-cure  (    )     %total 
not  return  to  clinics  (     )         % 

fail  test-of-cure  first  time  (    )     % 
fail  test-of-cure  second  time  (    )    % 

Use  of  Data  -  As  a  relatively  simple  and  straightforward  measure  of  use  of 
STD  protocols,  the  peer  review  will  give  managers  information  on  consistency 
and  thoroughness  of  clinic  procedures. 

As  a  way  to  better  design  STD  programs  and  plan  for  coverage  in  clinics,  data 
from  the  patient  survey  should  be  valuable.  Used  over  several  years,  or  as 
a  time  series,  the  questionnaire  could  give  an  idea  of  the  changing  levels  of 
knowledge  and  prevention  of  patients. 

As  a  means  of  outcome  evaluation,  the  matrix  and  running  total  will  give 
administrators  up-to-date,  measurable  progress  data  from  which  they  may  gauge 
effectiveness.  This  evaluation  measure  would  also  be  very  helpful  as  a  time 
series. 
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Objective  2.  To  Ac hieve  Effective  Screening  and  Treatment  at  an  Average  Cost 
of  TTS  per  Person  who  comes  in  for  Gonorrhea. 

Rationale  -  Cost  information  on  services  provided  is  often  the  most  important 
data  administrators  can  have.  When  budgeting,  planning  or  applying  for  grant 
monies,  accurate  figures  reflecting  true  costs  are  invaluable.  Administrators 
who  have  accurate  information  on  cost  per  STD  screen  and  treatment  can  track 
changes  in  needs  for  resources  and  revenues. 

Clarification  -  The  term  "effective  treatment"  for  purposes  of  this  objective 
v'-"'''  mean  diagnosis  of  gonorrhea,  medication,  disease  information  and  preventive 
counseling  resulting  in  patients  becoming  free  of  gonorrhea  within  seven  days. 

Methodology  -  Assuming  effective  treatment  (covered  in  Objective  1),  cost 
data  will  be  straightforward.  A  worksheet  will  be  developed  which  lists  all 
costs  to  the  health  department,  both  for  all  patients  (all  screened  for 
gonorrhea)  and  those  found  to  have  gonorrhea  and  treated.  Full  definitions 
and  parameters  will  be  attached  so  that  use  of  each  cost  is  clear. 


GONORRHEA  SERVICES 
HEALTH  DEPARTMENT  COST 


#  of 
Patients 


1 .  Personnel 

hr  X  fringe 


Health 
Department  Cost 


#  Patients 
Treated 


Health 

Department 

Cost 


2. 

Facilities 

3. 

Supplies 

A  more  complicated  model,  or  Levin  Table,  of  the  above  worksheet  will  be 
developed  for  use  by  those  who  want  to  compute  cost  by  including  such  factors 
as  private  contributions,  imposed  private  cost  and  adjusted  user  charges 
(Appendix  A) . 
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Use  of  Data  -  The  worksheet  is  easily  compiled  and  the  data  can  be  broken  out 
for  use  by  category.  Budgeting,  writing  grants  or  developing  new  fee  schedules 
can  necessitate  use  of  quality  and  consistent  data. 

Missoula  cost  data  will  be  made  available  to  other  health  departments  who  want 
to  use  it  on  a  comparison  basis  for  not  only  the  worksheet,  but  also  the  Levin 
Table. 

Objective  3. To  Locate  and  get  in  to  Medical  Care  90%  of  Reported  Gonorrhea 

Contacts  within  72  Hours  of  Report  at  a  Cost  of  $20  per  ContaTt. 

Rationale  -  The  cost  of  untreated  gonorrhea  was  estimated  to  have  been  $200 
million  in  1976.^^  Because  of  the  enormous  cost  to  society  as  well  as  the  risk  of 
infection  and  spread  of  the  disease,  public  health  has  traditionally  placed  a  high 
priority  on  locating  and  treating  contacts.  Because  time  is  of  the  essence  in 
contact  tracing,  a  measurable  objective  of  72  hours  has  been  established.  Ninety 
percent  was  determined  to  be  a  good  objective  because  of  the  importance  of  accuracy 
and  thoroughness.  Cost  data  is  important  to  administrators  who  want  to  keep  tabs 
on  their  costs  and  who  need  solid  cost  data  for  planning. 

Methodology  -  A  card  on  each  contact  will  be  started  as  reported.  Clinic 
personnel  can  then  track  the  steps  to  get  a  contact  in  to  treatment.  The  method- 
ology will  look  like  this: 


Date  •  Name/addres s/description   Not  located  '  HP  \  Patient  [    Other   Date  ;  Exam   R^  |  ER// 


%£? 
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y        ^  The  form  will  be  filled  out  completely  from  left  to  right.  A  flow  chart  explains 

the  process. 


Contact 
Cited 


■^  Not  located  (fill  out  "trace  form")  • 
No  Medical  Care 


■^   Located  "' 


To  Medical  Care  • 

a.  Health  Department 

b.  Physician 

c.  Other 


a   located  +  treated 


total 
For  each  step  in 


The  resultant  data  will  be  in  the  form  of  a  success  rate  (or 

Cost  data  will  be  gathered  by  use  of  a  similar  procedure, 
the  procedure,  a  cost  will  be  assigned.  For  negative  outcomes  occuring  where  the 
contact  is  either  not  located  or  does  not  seek  medical  care,  a  cost  figure  will 
also  be  separately  available.  A  worksheet  will  look  like  this: 


Contact 


Not  Located 


Personnel  time 
spent  in  attempt: 


phone 

personal 
tracing__ 
other 


Facilities:  $ 


Located 


Personnel  time 
spent  in  location: 

a.  phone  

b.  personal 
tracing  

c.  other 


Facilities:  $ 


time  spent  on 
follow-up  of 
contact  action 


Use  of  Data  -  Both  success  rate  and  cost  data  focus  mainly  on  personnel  time. 
It  should  be  noted  that  training,  over-time  and  space  for  phoning  or  interviewing 
is  also  necessary  for  complete  data.  Data  should  be  used  over  time  for  the  success 
rate  to  accurately  measure  changes  incurred  by  different  methodologies  and  out- 
side events.  Costs  of  locating  and  of  insuring  the  contact's  seeking  medical  care 
will  change  over  time  as  do  personnel  costs  and  new  methodologies  or  training. 
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Objective  4.  To  Reduce  the  Incidence  of  Gonorrhea  Repeators  f rom  30y  to  20 % 
of  Total  Gonorrhea  Patients. 

Rationale  -  Reducing  the  number  of  gonorrhea  repeators  is  a  good  way  to 
measure  effectiveness  of  patient  counseling,  public  av;areness  programs  and  ad- 
vertising campaigns.   Public  health  would  have  a  measure  of  success  if  ever  it 
could  say  that  it  has  reached  a  low  repeater  rate. 

Methodology  -  Clinic  nurses  will  be  asked  to  include  the  question  "Have  you 
ever  been  treated  for  gonorrhea  before?"  as  they  interview  patients  on  the 
initial  examination.   If  the  answer  is  yes,  a  list  of  quick  questions  will 
follow  (such  as  "when  were  you  treated?",  "what  preventive  practices  did  you 
use  to  avoid  getting  gonorrhea  again?").  Scores  will  be  assigned  to  pa tients  '  D^'^P^  p^_ 
responses  and  a  final  "risk  score"  will  be  used  to  indicate  their  being  at-risk 
for  getting  the  disease  again. 

In  addition,  the  STD  patient  questionnaire  (Objective  1)  will  also  cover 
,  ,^ . Jivism. 

Use  of  Data  -  As  a  general  measure  of  the  size  of  the  at-risk  population,  the 
patient  questionnaire  mentioned  earlier  and  the  short  "quiz"  will  let  adminis- 
trators know  the  extent  of  the  repeater  problem.  This  data  should  also  be  kept 
from  year  to  year  in  order  to  watch  changes  and  trends  over  time. 

Objective  5.  To  Maintain  a  Reporting  System  whereby  Cases  of  Gonorrhea  are 

Reported  to  the  Health  Department  within  48  Hours  of ' Confirmation. 

Rationale  -  An  unremitting  problem  of  public  health  is  the  low  rate  of 
communicable  diseases  reported.  It  has  been  estimated  that  "private  physicians 
who  treat  80%  of  venereal  diseases  in  the  United  States  only  report  approximately 
19/'  of  their  cases."   If  the  true  extent  of  the  problem  is  unknown,  then  it  is 
difficult  for  administrators  to  know  how  to  allocate  resources  to  impact  the 
STD  problem. 

Methodology  -  Because  of  the  lack  of  success  with  passive  reporting  systems, 
several  variations  of  an  active  system  will  be  tested  for  effectiveness.  It 
is  felt  that  passive  systems,  or  waiting  for  physicians  and  labs  to  report  on 
their  own,  have  compounded  the  puzzle  of  not  knowing  the  true  scope  of  STD 
incidence.  Active  reporting,  or  actively  contacting  the  medical  community,  is 
seen  as  the  only  way  to  maintain  a  grasp  of  true  disease  incidence. 
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As  such,  there  are  three  options  that  will  be  tested  as  to  their  effectiveness. 
The  first  step  for  all  three  will  be  to  interview  several  physicians,  labs  and 
emergency  room  personnel  about  reporting  to  get  .their  input.  Then  all  reporting 
sources  will  be  divided  into  three  groups  for  experimental  purposes.  ;;-; 

Group  I  -  will  be  called  each  Friday  afternoon  to  ask  for  reportable  ^:, 
diseases.  A  "Disease  Incidence  Form"  will  be  drawn  up  for  ^'^' 
health  department  personnel  use.  § 

'■^'■> 

Group  II  -  will  receive  a  "Disease  Incidence  Form"  by  Friday  of  each   ^ 

week  with  instructions  to  mail  it  back  by  Tuesday.        ,^, 

Group  III  -  will  receive  a  pad  of  "Disease  Incidence  Forms"  to  keep  g^- 
on  hand.  By  Friday,  they  will  receive  a  post-card  J 
reminder  to  fill  out  the  form  and  return  it  by  Tuesday.    '-' 

There  will  be  different  levels  of  staff  time  and  costs  used  for  each  of  the 
three  methodologies.  A  cost  analysis  will  be  drawn  up  for  each,  so  that  the  final 
decision  of  which  method  is  most  effective  will  be  also  cost-effective. 

Use  of  Data  -  An  accurate  and  consistent  reporting  system  will  yield  current 
disease  outbreak  information  to  not  only  public  health,  but  also  to  area  physicians 
if  desired.  This  will  fill  legal  requirements  as  well  as  give  administrators  an 
accurate  measure  of  gonorrhea  incidence  in  the  county  so  that  they  may  plan 
resource  allocation  and  staffing  patterns. 

Objective  6.  To  Actively  Provide  STD  Information  to  the  Public  at  a  Health 
Department  Cost  of  $20  per  Hour. 

Rationale  -  Prevention  has  always  been  an  important  part  of  the  control  of 
sexually  transmitted  diseases.  Dissemination  of  good  informational  material  has 
been  long  advocated  by  health  educators. 

An  often  cited  problem  has  been  social  perceptions  of  STD: 

...workers  in  the  field  of  venereal  disease  prevention  often  face 
a  double  barrier;  cases  may  not  surface  for  treatment  through  lack 
of  knowledge  of  symptoms,  through  embarrassment,  through  lack  of 
willingness  to  cite  sexual  contacts,  and  through  a  complex  of  attitudes 
which  render  venereal  diseases  'socially  unacceptable'  maladies. 
Further,  education  in  this  area  has  not  found  ready  acceptance  in  the 
community.  Thus,  current  cases  are  not  identified,  and  potential  cases 
are  not  given  the  awareness  which  would  help  them  to  protect  themselves 
against  infection,  or  to  seek  early  treatment. ^ 

It  is  a  well-known  phenomena  in  public  health  that  when  public  information 
efforts  are  stepped  up,  the  incidence  of  the  disease  goes  up  due  to  increased 
interest  and  reporting.  It  then  becomes  very  difficult  to  quantitatively  separate 
actual  STD  outbreaks  from  increased  knowledge  and  reporting. 

Outcome  measures  such  as  knowledge  and  attitude  questionnaires  and  process 
measures  like  number  reached,  hours  used  and  cost,  are  applicable,  however. 
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Methodology  -  The  methodology  for  the  objective  will  cover  health  education 
and  includes  number  reached,  costs,  knowledge  and  attitudes  of  patients  and 
audiences . 

Health  education  is  a  common  preventive  measure  used  by  public  health. 
Measuring  the  effectiveness  of  STD  information  as  given  to  Out-Patient  Clinic 
(OPC)  patients  and  school  children  will  involve  a  count  of  the  number  reached  and 
what  type  of  informational  session  it  was  as  well  as  use  of  the  questionnaire 
mentioned  in  Objectives  1  and  4. 

Control  groups  will  be  used  for  school  groups  as  well  as  clinics  to  assure 
that  valid  inferences  are  drawn  from  the  questionnaire  results. 

Counting  the  number  of  people  reached  with  STD  information  will  be  accomplished 
by  results  of  an  OPC  time  study.  Results  will  then  be  used  to  establish  average 
time  spent  on  STD  education  to  OPC  patients.  Health  Department  personnel  who 
present  STD  information  to  schools  or  elsewhere  will  be  provided  with  an  "STD 
Information  Time  and  Audience"  card  which  will  look  like: 


v)-^%r// 


PHN/HE 


STD  Information-Time  &  Audience  Card 

Date  Presentation 

To:         Number 


Comments : 


Time  Spent 

a.  Research  or  data 
collection       : 

Cost  (will  be  filled  in  by 
Research  Unit) 

b.  Phoning  and  meeting 
arrangements      : 

c.  Actual  session     : 

d.  Follow-up         : 

Costs  can  be  figured  on  the  right  side  of  the  card. 


6.1^ 


STD  Evaluation 
Page  15 


Use  of  Data  -  Results  from  the  time  spent  on  STD  information  and  number  of 
people  reached  will  be  immediately  of  use  to  program  administrators  who  need  to 
know  how  many  people  their  program  meets  and  at, what  cost.  The  data  from  the 
questionnaire  will  determine  how  much  clients  and  others  receiving  STD  information 
understand  the  diseases  and  their  prevention.  That  information  can  then  be  used 
to  tailor  future  information  and  education  efforts. 

Objective  7.  To  Achieve  a  Long-Term  Decrease  in  the  Gonorrhea  Rate  from  517  in 
1975  to  346  in  1980. 

Rationale  -  The  State  Health  Department  puts  out  a  gonorrhea  rate  - 

^reported  case     ^  100,000)  each  year.  The  easy  availability  of  this  data, 

^county  population      ^        j  j  j  j 

as  well  as  its  being  available  since  1969,  makes  it  the  logical  choice  to  use  to 

measure  trends  and  incidence  of  gonorrhea.  Several  cautions  must  be  noted, 

however.  First,  the  rate  is  calculated  on  estimated  county  population  which 

could  easily  change  the  rate  if  an  inflated  (or  underestimated)  population 

were  used.  Second,  the  number  of  cases  is  only  as  good  as  the  reporting  system 

that  gathers  the  data.   If  indeed  a  reporting  system  (Objective  5)  is  designed 

that  is  more  effective  than  the  old  system,  then  the  rate  will  change.  Third, 

changes  in  the  rate  must  be  carefully  attributed  -  was  it  public  health's 

impact?,  was  it  a  change  in  reporting  or  advertising,  or  a  STD  "scare",  was  it 

decreased/increased  carrier  time  from  allowing  each  case  to  infect  fewer/more 

others?,  or  was  it  another  of  the  many  outside  variables? 

Objective  7  was  included  to  provide  a  distinct  measure  of  either  an  increase 
or  decrease  in  gonorrhea  in  a  county.  Because  of  the  problems  of  measuring  a 
change  in  the  number  of  cases  (we  don't  really  know  the  number  of  cases,  or 
people  with  the  disease,  because  not  all  get  diagnosed  or  treated)  the  states 
figures  were  chosen  to  be  used. 

Methodology  -  The  State  Health  Department  figure  will  be  used  as  released  in 
"Gonorrhea  Incidence  by  County".  Both  a  graph  and  table  will  be  set  up  and  up- 
dated yearly  to  determine  changes  in  the  rate.  (If  desired,  a  county  may  wish 
to  maintain  a  monthly  graph  from  monthly  reported  gonorrhea  cases.) 
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600 


500 


GRAPH 
Missoula  County  Gonorrhea  Rate'' 


,(548)  • 


/     (5171 
(496)    /  "•    (491) 

400  .,y  (^77)       (J^g. 

(395) 


300 
200 

100      0(76) 


(312) 


•(120) 


1969  70    71    72    73    74    75    76    77    78    79 
county  population  58,263  66,800  69,700 

*cases  reported  per  100,000  population 


TABLE 
Missoula  County  Gonorrhea  Incidence 

YEAR  NUMBER  OF  CASES        RATE        COUNTY  POPULATION 

1969  44  76  58,263 

1970  75  129  58,263 

1971  182  312  58,263 

1972  289  496  58,263 

1973  230  395  58,263 

1974  319  548  58,263 

1975  301  517  58,263 

1976  278  477  58,263 

1977  328  491  66,800 

1978  289  415  69,700 
1979 


Use  of  Data  -  With  proper  and  thorough  analysis,  gonorrhea  trend  information 
can  be  vitally  important  tov/ards  effective  allocation  of  resources.   If  the  rate 
(or  even  monthly  incidence)  has  been  consistently  higher  (after  analysis  of  out- 
side forces),  then  a  vyay  must  bo  designed  to  combat  that  trend.   If  rates  are 
consistently  lov;er  (aftor  analysis  of  outside  forces),  then  perhaps  an  impact  has 
been  made  in  the  battle  against  gonorrhea. 
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Impliaations  of  STD  Model 

As   stated  earlier,    the  STD  Model    can  be  generalized   to   fit  other  health 
departments'  needs  and  other  sexually  transmitted  diseases    (where  this  model 
fits  gonorrhea  only).     The  methodologies  noted  in  each  objective  will   be  clearly 
laid  out  and  generally,  administrators  can  chose  the  level   of  data   they  require, 
whether  it  be  comprehensive  or  unadorned. 

Clear  measurements   are  available   in  either  meeting  or  not  meeting   the  seven 
objectives.      These,    too,   may  be   tailored   to   fit  a   particular  department's   needs. 
Missoula's   final    evaluation  data  will    be  made  available   to  any  administrator  who 
would  like   to   use   it. 

It  would  be  very  beneficial    for   the  majority  of   the  models    to  be  continued   from 
year  to  year   (or  quarterly,   etc)   as  a   time  series   in  order  to  watch   trends   and 
establish   baselines.     After  staff  become  familiar  with   the  evaluation  methodoloaies . 
this  will    be  a   very  easy  and  quick   process. 

Publication  of  the  methodology  and  results  of  this  evaluation  model   must  be 
considered.     The  extensive  literature  search  for  the  model    turned  up  very  little 
of  direct     use,   indicating  a  dearth  of  information  on  measuring   the  effectiveness 
and  efficiency  of  public  health  programs  nation-wide. 

November  1979 
Janice  S.   Hand 
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INTRODUCTION 

Explanation  of  Evaluation  Project  -  This  Users'  Guide  demonstrates  five  ways  to 
evaluate  your  Prenatal  Education  Program  —  from  class  evaluations  to  a  program 
cost  analysis.  The  evaluation  methodologies  are  a  result  of  the  two-year  Com- 
munity Health  Services  Evaluation  and  Planning  Project,  conducted  from  1979  to 
1981  by  the  Missoula  City-County  Health  Department. 

The  evaluation  project's  goal  is  to  provide  practical,  efficient  evaluation 
methods  that  public  health  administrators  can  use  when  evaluating  their  own 
programs. 

Scope  of  Prenatal  Education  Program  Evaluation  -  The  evaluation  methodologies  shown 
in  this  Guide  are  designed  to  evaluate  classes  given  to  first-time  parents  but  they 
could  easily  be  revised  to  evaluate  parenting  classes  as  well. 

Each  methodology  is  designed  to  fit  smoothly  into  your  health  department's  existing 
programs  and  to  produce  clear  and  immediately  useful  data.   Because  the  Missoula 
Health  Department  was  the  test  site  for  this  evaluation  model,  the  examples  shown 
in  this  Guide  are  based  on  Missoula's  programs  and  data.  You  may  need  to  modify 
some  parts  of  the  evaluation  to  fit  your  programs'  features,  or  expand  the  evaluation 
to  other  types  of  classes. 

Each  section  of  the  Guide  shows  Missoula's  test  results,  discusses  evaluation 
procedures,  details  evaluation  methodologies  and  provides  any  forms  used  to  collect 
data.   Program  cost  analysis  evaluation  sheets  and  questionnaires  are  copy-ready. 

Changes  from  Original  Evaluation  Plan  -  An  evaluation  plan  is  simply  a  brief  out- 
line of  proposed  work.  When  parts  of  the  Prenatal  Education  Evaluation  Plan 
proved  infeasible,  they  were  dropped  or  revised. 

1.  Evaluation  Objective  1,  Health  Outcomes  — Discussions  with  both  program 
managers  and  State  Maternal -Chi  Id  Health  authorities  led  to  our  conclusion 
that  a  health  score  is  beyond  the  scope  of  this  evaluation.   The  main 
reason  for  changing  this  evaluation  methodology  to  a  two-month  follow- 
up  is  that  there  are  so  many  exogenous  factors  influencing  a  mother's 
labor  and  her  birth  attitudes  —  from  her  education  level  to  her  family 
bacl<ground  to  her  physical  capacities.  A  large  scale  research  project, 
not  a  program  evaluation  of  this  size,  would  be  required  to  meet  this 
evaluation  objective. 

2.  Evaluation  Objective  2,  No-Show/Dropout  Survey  — After  conducting  a 
telephone  survey  of  no-show  and  class  dropouts  for  six  months,  we  found 
this  type  of  survey  was  not  cost-effective.   Most  of  the  respondents  had 
moved,  had  unlisted  phone  numbers  or  had  no  phone.   Staff  time  used  to 
collect  a  relatively  small  number  of  respondents  is  prohibitive.   The 
questionnaire  is  included  in  Section  1,  page  8  for  reference. 
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SECTION  1 

FOR  MORE  EFFECTIVE  CLASSES... 
A.   PARTICIPANT  PROFILE 

Results  -  The  Profile  Questionnaire  gives  class  leaders  the  general  background 
of  their  class.   Generally,  Missoula  parents  had  never  taken  a  prenatal  education 
class  before,  did  not  have  children  at  home,  lived  in  two-person  households, 
were  2k   years  of  age  or  younger,  and  were  probably  female.   The  most  commonly 
marked  yearly  income  was  less  than  $10,999,  and  most  respondents  reported  they 
had  completed  high  school.   When  asked  to  list  topics  they  would  like  to  see 
covered  in  the  classes,  respondents  were  most  likely  to  say  "exercises."  Results 
from  this  questionnaire  helped  staff  effectively  design  their  presentations 
toward  participants'  education  level,  their  prior  experience  wi th  classes  or 
children,  and  their  information  desires. 

Discussion  -  The  questionnaire  is  easy  to  fill  out  and  easy  to,  tabulate.   Question 
1  asks  about  their  having  taken  a  prenatal  education  class  before.   This, means 
any  type  of  class  and  includes  Lamaze  or  other  types  of  prenatal,  classes 
they  may  be  taking  currently.   Question  2  is  intended,  to  find  out  if  respondents 
have  any  (other)  children.   Question  3  is  a  tactful,  way  to,  get  the  number  of 
single  parents  in  the  class. 

Methodology  -  At  the  first  session,  briefly  explain  the' queStionnai re  and  ask 
class  participants  to  fill  out  the  Pfoflle;   Be  sure  t6  collect  al 1  questionnaires 
and  tabulate  as  soon  as  possible  so  th6  t: lasts  leader 'cati  review  the  survey 
results. 

B.   CLASS  EVALUATION 

Results  -  Class  evaluation  showed  that  participants  generally  best  liked  the 
classes  covering  labor  and  delivery,  infant  care,  and  exercises.  They  least 
liked  classes  covering  anatomy  and  physiology.  Results  varied  from  class  to 
class,  however. 

The  Topics  Questionnaire  showed  that  participants  felt  the  most  important 
topics  were  nutrition,  breast  and  bottle  feeding,  exercises,  and  labor  and 
delivery.   They  were  less  interested  in  topics  of  assert iveness,  wills,  fetal 
growth  and  development,  and  family  planning. 

Discussion  -  There  are  two  class  evaluation  forms  (pages  1.5  and  1.6  ) 
presented  in  this  evaluation.   It  seemed  that  if  participants  filled  out  the 
same  form  for  each  class,  they  got  used  to  the  form  and  began  to  skip  through 
it  quickly,  giving  less  and  less  input  from  one  session  to  another.   Changing 
from  one  format  to  the  other  helped  solve  this  problem.  Also,  stressing  the 
importance  of  participant  input  wHl  increase  response. 

Section  1,  Page  1 


The  Possible  Topics  for  Discussion  Questionnaire  should  be  tailored  to  fit 
your  program  and  classes,  so  you  may  need  to  change  the  topics  listed. 

Methodology  -  Ask  class  participants  to  fill  out  an  evaluation  form  before  they 
leave  each  session,  emphasizing  the  Importance  of  participant  evaluations. 
The  short  forms  are  easily  tabulated  and  results  are  easy  to  analyze. 

The  Topics  Questionnaire  is  most  effective  when  the  class  leader  stresses  its 
use  and  asks  the  class  to  fill  the  form  out  at  the  beginning  of  the  session. 
The  form  is  easily  tabulated. 


C.   ATTENDANCE 

Results  -  The  Missoula  Health  Department  has  been  particularly  concerned  with 
increasing  the  number  of  fathers  attending  its  prenatal  education  class. 
Attendance  records  show  that  the  percent  has  increased  from  an  average  of  2k% 
in  1980  to  an  average  of  35%  in  the  first  half  of  I98I.   Missoula  has  almost 
met  its  objective  of  increasing  the  percentage  of  fathers  attending  classes 
by  50%  by  January  I98I  by  an  increase  of  46%. 

In  addition,  attendance  records  show  the  percentage  of  people  attending  at 
least  five  of  the  six  sessions  has  increased  from  2k%   to  50%  from  I98O  to  198I . 

These  results  are  due  to  (1)  increased  public  service  announcements,  posters  and 
newspaper  coverage,  (2)  changes  in  class  outlines  to  better  meet  participants' 
needs,  and  (3)  group  leaders  no  longer  giving  schedules  of  the  classes  so 
participants  are  less  likely  to  skip  "less  interesting"  sessions. 

Discussion  -  Women  who  attend  prenatal  education  sessions  with  their  partners 
are  more  likely  to  complete  the  class  than  women  who  attend  alone,  so  increasing 
the  number  of  fathers  attending  is  important.   In  addition,  class  costs  are 
considerably  higher  if  class  participants  sign  up  but  do  not  attend  classes, 
or  if  they  drop  out  of  the  class.  Making  prenatal  education  classes  efficient 
includes  decreasing  class  no-show  and  drop  out  rates. 

Methodology  -  Page  1.7  shows  a  suggested  class  registration  form  that  can  be 
filled  out  each  session  and  then  tabulated  to  give  statistics  on  (I)  number 
attending  five  or  more  sessions,  (2)  no-shows,  (3)  number  of  fathers,  and 
(A)  drop  outs.   To  be  useful,  the  attendance  sheet  should  be  completed  each 
session,  a  separate  listing  shown  for  each  father  and  the  sheet  should  be 
compiled  after  each  session  and  then  results  compared  yearly. 
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PRENATAL  EDUCATION  PROFILE 

Please  take  a  oouple  of  minutes  just  now  to  answer  these  questions.      Your  group  leader 
will  be  able  to  design  sessions  that  better  fit  your  needs  if  she  knows  what  type  of 
people  are  in  your  group.      Thank  you\ 


Have  you  ever  taken  a  prenatal  education  class  before? 


yes 
no 


->  if  yes,  what  type  of  class? 


Do  you  have  any  children  at  home  now? 


yes 

no 


->  if  yes,  please  write  down  each  child's  age 


3.   How  many  people  live  in  your  household,  besides  yourself? 

U.      Please  check  your  age  range: 

under  15  years  old 

_  15-19 

20-2A 

_  25-29 
_  3O-3A 

35  years  or  older 


5.  Are  you: 

male 

^f  ema  1  e 

6.  What  is  your  approximate  yearly  income,  before  taxes? 

less  than  $5,000 

_  $  5,000  to  $  7,999 
_  $  8,000  to  $10,999 

$11,000  to  $13,999 

_  $U,000  to  $16,999 
$17,000  or  over 

7.  Please  circle  the  last  year  of  school  that  you  have  completed; 


6  7 


GRADE 


9   10  11   12 
HIGH  SCHOOL 


13   1^   15   16 
COLLEGE 


17  and  over 
MS/PhD 


Please  list  any  topics  that  you  would  particularly  like  to  see  covered  in 
Prenatal  Education  sessions. 
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For  Parents  —  Possible  Topics  for  Discussion 

This  survey  is  to  find  out  what  topics  participants  would  like  to  discuss 
and  explore.     Please  circle  the  number  that  most  closely  shows  how  much 
you  would  like  to  talk  about  each  topic  listed.      "1"  means  not  important 

to  you  and     "5"  means  very  important  to  you.     List  any  other  topics  that 

you  would  like  to  see  discussed  at  the  bottom  of  the  page.  >c 

a.  How  a  Fetus  Grows  and  Develops 1    2    3  4  5 

b.  Mothers'  Body  Changes  Dviring  Pregnancy  ...   .1    2    3  4  5 

c.  Nutrition  —  Mothers  and  Babies,  Before 

and  After  Birth 1    2    3  4  5 

d.  Breast  Feeding  vs   Bottle  Feeding  — 

Advantages,  Disadvantages   &  Breast  Care  ...  1    2    3  4  5 

e.  Exercises  for  Mothers  —  Pre  and  Postnatal  .   .    1    2    3  4  5 

f .  Lamaze  —  What  Is  It?  Who  Benefits? 1    2    3  4  5 

g.  Labor  &  Delivery  —  What  Choices  Do 

Expectant  Parents  Have?  1    2    3  4  5 

h.  Infant  Care  —  At  the  Hospital  and  at  Home  .   .   .1    2.    3  4  5 

i.  What  Emotional  Changes  to  Expect  When 

Parents  Take  New  Baby  Home 1    2    3  4  5 

j .  Assertiveness  and  the  Health  Care  Professional   12    3  4  5 

k.  Use  of  Cardio-Pulmonary  Resuscitation  on 

an  Infant 1    2    3  4  5 

1.  Community  Activities  Available  for  Families 

and  New  Parents 1    2    3  4  5 

m.  Family  Planning  Options 1    2    3  4  5 

n.  The  Caesarean  Birth  Experience 1    2    3  4  5 

o.  Providing  for  Baby  -  Do  Parents  Need  Wills?  .   .  1    2    3  4  5 

p.  Car  Seats  -  Do  I  Need  to  Have  One? 1    2    3  4  5 

OTHE  R : ^_______^ 

THANK   YOU  I  " 
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class  leader 


PRENATAL  EDUCATION  CLASS 
Registration 


dates 

attandanre 

name/address/phone 

jsh  6/81 
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DROPPED  FROM  PROJECT  -   FOR  REFERENCE  ONLY 

PRENATAL  EDUCATION  CLASS 
No-Show/Dropout  Survey 


Hello,  Mp/Me  ,  my  name  ie  ^___  from  the  Health  Department. 

I'm  oalling  to  talk  to  you  about  the  Education  for  Parenthood  eeeeions 
that  you  were  interested  in.     The  Health  Department  hoe  aeked  me  to 
find  out  what  people  want  from  the  olaaees  and  why  eome  are  not  able  to 
attend.     Your  aenwere  are  completely  confidential.     I'd  really  appreciate 
your  help  with  the  survey.     First  of  all  .    .    . 


1.  How  did  you  first  hear  about  Education  for  Parenthood  classes? 
Q    newspaper  Q  public  health  nurse 

[]]]    friend  or  relative  □  other:  

n  wic 

2.  Do  you  currently  have  any  children? 
Q]  yes  How  many?  

Dno 


3.  Have  you  ever  been  to  a  prenatal  education  class  of  any  sort  before? 

□  yes Which  one? Did  you  enjoy  It? yes 

no 

□  no  Why  not? 

4.  What  sorts  of  things  did  you  expect  to  learn  when  you  sloned  up  for  the  classes? 


5.  Why  were  you  unable  to  go  to  Education  for  Parenthood  Classes? 


6.  Why  were  you  unable  to  continue  going  to  Education  for  Parenthood  Classes? 


YES 

NO 

YFS 

NO 

YFS 

NO 

YFS 

NO 

YES 

NO 

YES 

NO 

7.  Do  you  feel  there  were  too  many  people  in  the  class? 

7.  Do  you  feel  there  were  too  many  people  In  the  class? 
Was  the  class  too  long  for  you? 
Was  the  location  of  the  class  good  for  you? 
Was  the  class  held  at  a  poor  time  of  the  day? 
Was  parkinq  a  problem  for  you? 
Did  you  like  to  group  leader  (nurse)? 

8.  That's  all  I  have.  Do  you  have  any  general  conwnents  on  the  classes? 


THANK  YOU! 

DROPPED  FROM  PROJECT  -  FOR  REFERENCE  ONLY  10/80  jsh 
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SECTION  2 
PROGRAM  COSTS 

Results  -  The  Missoula  Prenatal  Education  Program  cost  $3,790  in  FY  I98I.   This 
cost  included  $2,883  of  personnel  costs  and  $865  for  department  overhead.   The 
average  cost  per  class  participant  (N=138)  is  $27,  based  on  the  number  of 
participants  who  came  to  at  least  one  of  the  six  sessions. 

Discussion  -  Cost  information  is  easy  to  collect  and  tabulate  for  prenatal 
education  programs.   Program  costs  are  used  for  budgeting,  planning  and  decision- 
making. 

Methodology  -  Fill  out  a  Prenatal  Education  Class  Time  Sheet  (page  2.2)  for 
each  class  taught.   Using  that  data,  the  cost  analysis  is  easy  to  complete.  A 
detailed  explanation  of  the  analysis  is  printed  on  the  back  of  page  2,5.   A 
department  overhead  worksheet  is  also  provided  for  the  overhead  percentage  needed 
for  I tem  6. 


Section  2,  Page 
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PRENATAL  EDUCATION  CLASS 
Time  Sheet 


For  class  to 

Group  Leader  


Class  Background  Time  (sahedulingy  research^  public  relations,   phone  calls,   etc.) 


In-Class  Time     (actual  time  spent  in  class  each  night) 


Mileage     (if  any  -  includes  follow-up  and  client  visits  related  to  class) 


Evaluation  Time       (evaluation  of  class  —design,    tabulation,  analysis,   etc.) 


Class  Wrap-up     (time  spent  winding  up  the  classes) 


Keep  time  in  quarter-hour  increments  —15  min.   shown  .21 

2.2 


1) 


OVERHEAD 
Health   Department    Cost    Analysis 


The  purpone  of  thit;  coat  worknhnct   is    to  provide  a    "foi-nula"   to  he 
uised  to  deiermine  the  ooevhead,   or   "cout  of  doinij  buninesfl," 
on  a  permmtatie  basis  so  that  overhead  costs  can  he  fairly  allocated 
to  each  particular  health  department  program. 


1.      Admini St  rat i 


:J 


a.  Health  Officer 

b.  Administrative  Assistant 

c.  Administrative  Secretary 

d.  H.D.  Receptionist 

e.  H.D.  Accountant 

f.  Vital  Statistics  Clerk 
q.  Medical  Consultant 

h.  Other: 


2 .   Other  Administrative  Personnel  Expenses 

a.  Termination  Reserve 

b.  Recruitment  

c.  General  Conferences  &  Meetings     

d.  General  Training 

e.  General  Books  £  Periodicals 

f.  Administrative  Travel  

(1.  Other: 


2.3 


OVERHEAD 
Health  Department  Cost  Analysis 


Overhead  is  a  faator  designed  to  oaloulate   the  total  costs  of  admin- 
istering a  program.      It  should  be  noted  that  overhead  is  an  estimation 
of  the  health  department's  administration  of  all  department  programs, 
all  of  which  overlap;   hence,    the  need  for  an  overhead  figure. 


Total  Administrative  Sal 


This  means  salaries  plus  appropriate  yearly  fringe  benefits  and  merit  raises 
of  only  personnel  involved  in  the  general  administration  of  the  health  department. 
(Other  personnel  may  be  added  if  other  departments  are  organized  differently. 
For  example,  a  health  department  personnel  director  or  assistant  health  officer 
should  be  added  to  this  category.)   The  receptionist  is  the  person  who  acts  for 
the  entire  health  department,  the  general  office  clerk  (or  a  portion  of  her/his 
salary)  acts  as  vital  statistics  clerk. 

To  calculate  (a),  or  total  administrative  salaries,  multiply  total  salaries 
(which  should  include  yearly  raises)  by  yearly  fringe  percentage. 

Other  Administrative  Personnel  Expenses 

"Termination  Reserve"  means  those  monies  set  aside  to  pay  vacation  and  sick  pay 
severance  to  employees  who  quit.   "Recruitment"  means  costs  budgeted  for  newspaper 
ads,  printing  and  other  costs  of  filling  vacant  positions.   "Conferences  and 
Meetings"  refers  to  those  of  general  interest  to  health  administration  and  not 
applicable  to  a  specific  program.   "Training"  means  general  mangement  or 
administrative  training,  not  that  attributable  to  a  specific  program.   The  "Books 
and  Periodicals"  category  includes  general  health  planning,  public  health,  and 
management  materials  of  general  interest  and  not  attributable  to  a  specific 
program.   "Travel"  means  general  health  department  trips  and  excludes  travel  for 
specific  programs  or  conference  travel  (to  be  included  under  "Conferences  and 
Meetings").   Blanks  are  provided  for  other  categories  specific  to  the  general 
administration  of  a  health  department.   Add  all  these  categories  to  get  Total 
Administrative  Personnel  Expenses  (b) . 

Other  Administrative  Expenses 

Expenses  in  this  category  are  those  which  are  general  to  the  running  of  an 
agency.   Since  it  is  virtually  impossible  to  split  out  the  number  of  pencils, 
pieces  of  paper  and  the  like  used  by  one  program  or  activity,  it  is  a  good  deal 
easier  to  include  these  as  a  total  category  and  be  able  to  easily  allocate  them 
in  the  department  overhead  computation.   (The  only  exception  to  this  would  be 
grants  where  administrative  expenses  are  each  listed  and  funded  separately  and 
should  be  allocated  as  such.)   Office  supplies,  copies  and  printing,  postage, 
office  equipment  and  phone  are  total  costs  per  year  for  the  whole  department 
excepting  grant  allocations.   Interest  on  warrhnts  is  interest  paid  on  monies 
borrowed  from  a  bank  to  cover  current  department  operating  expenses  (if  applicable). 
Other  administrative  expenses  should  be  included  In  this  category  if  they  are 
attributable  to  the  general  operation  of  a  department.   (Note:   It  Is  more  accurate 
and  easier  to  charge  vehicle  expenses  to  the  program  which  uses  them  on  a  cents- 
per-mile  basis.   It  is  also  a  good  deal  more  difficult  to  charge  phone,  office 
space  and  the  like  out  on  a  program-by-program  basis.) 

Building  and  Maintenance 

Housing  costs  are  to  be  included  in  the  overhead  computation  because  of  the 
difficulty  of  allocating  square  footages,  utilities,  phones,  etc.,  to  each  program 
or  activity.   This  category  should  cover  all  housing  expenses  of  the  department 
and  laboratory. 

Other  Expenses 

This  category  should  include  costs  of  routine  audits,  administrative  consultants, 
depreciation  on  capital,  or  other  similar  items. 
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3.   Other  Administrative  Expenses 

a.  All  Office  Suppi ies 

b.  All  Copies  and  Printing 
*  c.  All  Postage 

d.  (Kfice  Equipment  t  Maintenance 

e.  All  Telephone  Charges 

f.  Interest  on  Warrants 


'4.   Building  and  Maintenance 

a.  Rent  OR  $ per  sq.  foot 

X  number  of  sq.  feet  of  office, 
lab,  etc. 


"T^ 


b.  Maintenance 


c.  Ut  1  1  I  ties 


d.  Insurance 

e.  Other: 


5.   Other  Overhead  Expenses 
Other: 


bui Iding  and 
(d)    ma  i  ntenance 


1^ 


other  expenses 


TOTAL  OVERHEAD  COSTS  = 


Overhead  Computation  = 


total  H.D.  salaries  +  fringe 


=  OVERHEAD  (30?„) 


2.4 


FY 


actual 
~  estimated 


1) 


PRENATAL  EDUCATION  PROGRAM 
Cost  Analysis 


The  purpose  of  this  cost  analysis  is  to  provide  a  formula  to 
determine  the  costs  to  the  Health  Department  of  conducting 
prenatal  education  classes. 


1.  PERSONNEL  COSTS 

a,  group  leader  time  x  (salary  +  fringe)  $ 

b.  other  personnel  time  x  (sal.  +  fr.) 


2.  NURSING  ADMINISTRATION  COSTS 

a.  Nursing  Director 

b.  Nursing  Supervisor 

c.  Clerical 

d.  Other 

3.  MATERIALS 
List: 


total  personnel 
costs 


k.    MILEAGE  @  i/m\. 

5.  TRAINING,  BOOKS,  PERIODICALS 
List: 


6.  OVERHEAD  @  %   of  personnel  costs 

7.  OTHER: 
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PROCEDURE 
Prenatal  Education  Program  Cost  Analysis 

Note:  Eaoh  health  department  has  its  own  system  of  tracking  costs. 
This  cost  analysis^   designed  to  provide  a  convenient  method  of 
determining  program  costs,   can  he  changed  to  reflect  your 
department's  specific  situation  or  cost  accounting  system. 

1.  PERSONNEL  COSTS:  There  are  three  ways  to  calculate  personnel  time:  (l)  from 
a  Prenatal  Education  Class  Time  Sheet,  (2)  from  department  time  sheets,  and 
(3)  from  estimates.   Staff  should  include  time  they  spend  on  the  telephone  and 
other  less  obvious  costs  in  their  time  sheets.   Multiply  salary  plus  the  fringe 
benefit  percentage  times  the  time  spent  on  the  classes  to  get  personnel  costs. 

2.  NURSING  ADMINISTRATION  COSTS:  This  category  shows  direct  administrative  costs 
which  are  the  costs  of  directing  and  supervising  the  program.   These  costs  can 
be  calculated  as  a  percentage  (10%  is  a  general  estimate)  of  total  program 
personnel  costs  If  no  better  records  are  available. 

3.  MATERIALS:  This  category  covers  the  cost  of  pamphlets,  copies  and  other  hand- 
outs.  Use  actual  costs. 

k.    MILEAGE:  If  accurate  records  are  not  available,  mileage  can  be  estimated. 

5.  TRAINING,  BOOKS,  PERIODICALS:  These  should  be  only  costs  specific  to  the 
Prenatal  Education  Program.   Costs  which  are  general  to  public  health  should  be 
allocated  to  department  overhead  (see  Overhead  Cost  Analysis). 

6.  OVERHEAD:  This  category  provides  a  way  to  include  building,  maintenance, 
and  general  health  department  administration   (health  officer,  accountant, 
other  administrative  support)  in  program  costs.   See  Overhead  Cost  Analysis 
Worksheet  to  determine  department  overhead  percentage. 

7.  OTHER:  Any  other  costs  not  covered  in  the  above  six  categories. 
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actual 
4/  est  imated 
"^  per  o.u<.s  of  ncorps 


PRENATAL  EDUCATION  PROgRAM 
Cost  Analysis 


Tlh!  purpose  of  this  cost  analysis  is   to  provide  a  formula  to 
d(-'- Leyniine   the  costs   to   Uie  Health  Department  of  aonduating 
prcHiital  eduaation  classes. 


1.  PERSONNEL   COSTS 

a.  group    leader    time   x    (safary  +   fringe)    $    /3 S% 

i^dwei  X  24lvr.  j-  (?•  1 3  +   /.  30) 

b.  other    personnel    time   x    (sal.    +   fr.)  390 

/0>x*rH.cl(iuM  ^.h)  6  X     2Ux  CI.  82  f   /-Zr)./«? 
Brenit  Red.  CJV.)(<.X     ^^^^  SJ'i  +  ,  fz).  ,fj, 

2.  NURSING  ADMINISTRATION  COSTS 
a.  Nursing  Director  J'i2 


.1  ng    ui  rector 

/0kn/(^.  (it-ll  i-  190) 


b.    Nursing    Supervisor  A^^ 

r.    Clerical^  <  20>.rK^,/v't.«<:r.)'  7/5^ 

d.    Other    —  — 


Pt^i5     total  per-oo7mel 
cos  ts 


3.    MATERIALS  SO 


List:   Mi»c.  copier        4sr)cla>*o 

^.    MILEAGE    g   ;toC/mi.     y  fc  X  /Owi.  „  /^ 

5.  TRAINING,  BOOKS,  PERIODICALS  — 

6.  OVERHEAD  fj  30^;^  of  personnel  costs  (,28^5)  ^^5" 

7-  OTHER:    .  — 


y  '  0/81       -sh  I  3790  I  COST  OF  PROGRAM 
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SECTION  3 
TWO-MONTH  FOLLOW-UP 

Res  111  tS  -  An  effort  to  complete  the  Two-Month  Fol  low-Up  study  was  unsuccessful. 
Problems  of  transient  population,  disconnected  numbers,  wrong  numbers,  and  class 
length  changes  (from  six  weeks  to  four  weeks),  hindered  the  success  of  this  study. 

When  the  study  began,  most  participants  gave  birth  two  months  after  the  last 
session.   Now,  with  four  rather  than  six  weeks  of  class  and  the  request  for 
participants  pregnant  through  their  fifth  month,  telephone  survey  problems 
are  accentuated.   For  a  successful  Fol low-Up  study,  it  will  help  if  the  last 
class  is  taught  within  two  months  of  the  delivery  date  of  class  participants. 

Discussion  -  One  of  the  most  Important  parts  of  a  program  evaluation  is  a 
measure  of  its  outcome.   The  Two-Month  Fol low-Up  appears  to  be  the  best  way  to 
measure  outcome  of  the  Prenatal  Education  Program.   Although  more  accurate  data 
is  possible  through  thorough,  longitudinal  studies,  they  are  outside  the  scope 
of  this  project  and  would,  in  any  event,  be  very  costly  and  time-consuming. 

The  Two-Month  Fol low- Up  is  designed  to  get  feedback  from  past  class 
participants  about  which  parts  of  the  class  were  and  were  not  helpful  now 
they  have  had  their  babies.   The  Fol low-Up  can  find  out  if  participants  were 
unhappy  with  classes. 

Methodology  -  Telephone  follow-ups  can  be  very  difficult  to  conduct  because 
people  move  or  do  not  have  phones,  so  it  is  particularly  important  to  get 
good  phone  numbers  and  addresses  during  class  registration. 

During  the  interview,  (l)  be  sure  to  establish  rapport  with  the  respondent 
by  being  businesslike,  pleasant  and  answering  all  the  respondent's  questions, 

(2)  read  each  question  exactly  as  it  is  written,  or  you  could  bias  your  results, 

(3)  probe,  or  say  "anything  else?"  on  the  open  questions  (#3,  A,  7)  to  be  sure 
you  have  all  the  respondent's  answers,  and  (k)    record  the  respondent's  comments 
verbatim  —  do  not  try  to  put  them  in  your  own  words. 

The  sample  size  should  be  everyone  you  can  reach.   Please  recognize  that  the 
major  weakness  of  this  type  of  phone  survey  is  that  you  will  not  reach  a  highly 
transient  population  or  those  without  a  telephone.   This  does  introduce  a  certain 
amount  of  bias  into  your  survey. 
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Two  Month  Fo 1 1 owu p 
Prenatal  Education  Class  Parti 


RespondetU  Data 

C-section 

induced  labor 

breast  feeding 

bottle  feeding 


I  pants 


Hello,   Mr/Ms   __^_ ,   I'm   from  the  Health  Department.      Several  months 

aijo,   ijou   took  an  Education  for  Parenthood  Class  from  the  Health  Department. 
Noto  that  you've  had  your  baby,   we're  aontaoting  you  and  others  in  your  class. 
We'd  really  appreciate  your  help  with  a  short  survey.      First  of  all   .    .    . 


1.   Was  this  your  first  baby? 
□  yes 
f  I  no  ^  Including  this  baby,  how  many  children  do  you  have? 


2.   Did  you  take  other  prenatal  education  classes,  other  than  Educati 

I  I  yes >  Which  classes  did  you  take? 

I  I  no  >  Do  you  wish  you  had  taken  other  classes,  too?    yes- 


->  which  classes? 


why  do  you  say  that? 


3.   Thinking  back  to  all  the  Education  for  Parenthood  sessions,  which  session  or  topic  has 
proven  to  be  the  most  useful  to  you? 


h.      Which  session  or  topic 


Id  have  been  left  out? 


;Iasse 


5-      Now   that   you've   had   your   baby,    how  useful    were    the   c 

Labor  and   Delivery  ^ 

C-Sections? 

The  Hospital  Tour? 

Breast/Bottle  Feeding  6  Nutrition? 

Prenatal  Relaxation  Exercises? 

Infant  Care? 


I'^-l 

0°^ 

o''^ 

k 

k 

h 

h 

k 

^ 

6.      Do  you  believe  the  Education  for  Parenthood  classes  should  have  taught  more  or  covered 
more  topics  than  they  did? 

I  I  yes =>  What  topics  would  you  have  liked  covered? 

D  no 


What  other  comments 


improve  the  classes? 


The  Health  Department  is  considering  offering  infant  care  classes  which  would  cover  topi 
like  babies'  growth  and  development  at  different  stages,  babies'  nutritional  needs,  and 
how  to  know  when  to  go  to  the  doctor  when  your  baby  is  sick.  If  sessions  like  that  were 
offered,  would  you  be  interested  in  attending? 

I  I  yes — =>  What  other  topics  would  you  like  to  see  offered? 

I  I  no  — >   Why  do  you  say  you  wouldn't  be  interested? 


THANK  YOU  FOR  YOUR  HELP! 


JSH/sIp 
k/8\ 


Interviewer/Date 
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SECTION  4 
PRENATAL  EDUCATION  EVALUATION  PLAN 

The  increased  interest  in  prepared  childbirth  in  the  United  States  has  grown 
rapidly  since  the  Lamaze  method  came  into  use  approximately  20  years  ago.   Pre- 
natal classes,  usually  taught  by  public  health  departments,  medical  facilities  or 
sponsored  by  community  groups,  have  become  a  common  offering  to  parents  in  many 
communities. 

In  Montana,  public  health  nurses  have  been  teaching  Prenatal  Education  classes 
(sometimes  called  Education  for  Parenthood  classes)  for  at  least  two  decades. 
Currently,  43  of  Montana's  56  counties  offer  prenatal  classes.   Many  are  taught 
by  public  health  nurses  on  a  voluntary  basis  and  all  follow  the  State  Health 
Department's  recommended  "discussion  method,"  whereby  parents  and  parents-to- 
be  are  encouraged  to  actively  participate  in  class  discussions  and  not  just  sit 
and  listen  to  lectures  by  "experts".   The  courses  are  generally  open  to  anyone 
in  the  community  without  charge. 

Few  evaluation  studies  have  been  conducted  on  a  nation-wide  basis  and  none  in 
Montana  since  prenatal  education  classes  began.   Public  health's  interest  in 
relevant  evaluation  data  upon  which  to  base  program  decisions  has  grown,  resulting 
in  approval  of  the  Community  Health  Services  Evaluation  Project  in  1979.   The 
project  is  designed  to  provide  evaluation  methodologies  and  data  for  eight  public 
health  programs  in  Montana.   The  Missoula  City-County  Health  Department,  as  per 
its  contract  with  the  State  Health  Department,  is  responsible  for  developing 
evaluation  models  for  eight  public  health  programs,  testing  the  methodologies, 
refining  them  as  necessary  and  then  distributing  "user  guides"  to  the  State  and 
local  health  departments  for  use  in  their  internal  evaluations.   The  Prenatal 
Education  Model  will  be  designed  so  that  health  departments  may  use  all  or  parts 
of  the  methodologies  to  construct  management  data  on  their  courses. 

Literature  Search 

After  conducting  an  extensive  literature  search  and  talking  with  maternal-child 
health  experts,  it  is  evident  that  little  other  evaluation  work  is  available 
for  use  as  background  in  designing  this  evaluation.   A  review  of  the  few  relevant 
works  follows: 
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Smith,   D.,   Smithy   H.  Describes  a  pilot  program  developed  at  . 

"Toward  Improvements  in  an  urban  community  hospital  designed  to         ' 

Parenting .  "  ^  strengthen  classes  for  new  and  expectant 

parents.     Results  from  a  project  survey 
indicate  that  parents  '  knowledge  of  child 
development  did  improve  considerably  as 
a  result  of  the  parent  education  project. 

Zwirn,   E.j   Fry,   L.B.,   et.   al.j  Describes  a  data  collection  system  designed 

"Childbirth  Education  Evaluation:  to  evaluate  a  childbirth  education  pro- 

The  Indianapolis  Experience."  ^  gram's  performance  and  to  plan  for  future 

growth.     Data  was  gathered  on  client 
origin,   source  of  referral,    labor  and 
delivery  experience  and  an  instruction 
and  class  evaluation. 

Watson,   J.  Study  compiled  a  socioeconomic  profile  of 

"Who  Attends  Prepared  parents  attending  prepared  childbirth 

Childbirth  Classes?"  ^  classes.     Results  show  that  parents  were 

generally  well  educated,    26  years  or 
older,   heard  of  the  classes  through  word 
of  mouth  or  by  their  physicians  and  are 
employed  in  professional,   technical  or 
managerial  occupations. 

The  scarcity  of  relevant  background  material  made  input  from  authorities  parti- 
cularly  important  to  this  evaluation.   Efforts  will  be  continued  to  gather 

f 
applicable  studies  and  information  throughout  the  project.   The  following  people 

were  consulted  for  input  for  the  evaluation: 

•  David  Feffer,  Health  Officer,  Crystal  Day,  Nursing  Director,  Missoula 
City-County  Health  Department,  Missoula,  Montana. 

•  Don  Pizzini,  Health  Officer,  Cherry  Travis,  Nursing  Director,  Cascade  City- 
County  Health  Department,  Great  Falls,  Montana. 

•  Edward  King,  Health  Officer,  Jackie  Stonnel,  Nursing  Director,  Gallatin 
City-County  Health  Department,  Bozeman,  Montana. 

•  Bruce  Mclntyre,  Health  Officer,  Audrey  Gonzales,  Coordinator  of  Nursing, 
Flathead  City-County  Health  Department,  Kalispell,  Montana. 

•  Bob  Johnson,  Health  Officer,  Shirley  McGuire,  Nursing  Director,  Lewis  and 
Clark  Health  Department,  Helena,  Montana. 

•  George  Sheckleton,  Health  Officer,  Jan  Treml,  Deputy  Director,  Yellowstone 
Health  Department,  Billings,  Montana. 

•  Bill  Burke,  Health  Officer,  Silver  Bow  Health  Department,  Butte,  Montana. 

•  Fay  Sweeney,  Maternal-Child  Health  Nursing  Consultant,  Maternal-Child 
Health  Bureau,  State  Department  of  Health  and  Environmental  Sciences, 
Helena,  Montana. 

•  Marlene  Garvis,  Hennepin  County  Medical  Center,  Minneapolis,  Minnesota. 

•  Betty  Tableman,  Michigan  State  Health  Department,  Lansing,  Michigan.         ( 

•  Kathryn  Barnard,  Professor  of  Nursing,  University  of  Washington,  Seattle, 
Washington. 
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METHODS  OF  PROCEDURE 

The  goal  of  the  Prenatal  Education  Program  is  to  insure  a  healthy  outcome  for 
parents  and  infants  —  mentally,  emotionally  and  physically  —  through  under- 
standing pregnancy,  labor  and  delivery,  and  infants'  growth,  development  and 
behavior  —  by  participating  in  prenatal  education  courses. 

It  has  been  said  that: 

Every  day  thousands  of  people  embark  on  one  of  the  most  difficult 
of  all  endeavors  -  parenthood.   Most  couples  are  caught  unprepared 
for  the  realities  of  this  new  phase  of  development  and  education 
programs  that  discuss  the  problems  of  living  with  an  infant  on  a 
24-hour  basis  are  not  widely  available.  ^ 

The  Prenatal  Education  Program,  designed  to  help  interested  parents  prepare 
for  prenatal/postpartum  processes  and  parenting,  is  based  largely  on  the 
philosophy  that  parents'  knowledge  of  their  children's  development  is  a  large 
factor  in  influencing  parent-child  interactions.   The  courses  offer  information 
on  nutrition,  breast  and  bottle  feeding,  exercises  for  the  pregnant  woman,  the 
labor  and  delivery  process,  infant  care,  and  often,  a  hospital  tour. 

Although  prenatal  education  courses  have  gained  general  wide-spread  support  and 
acclaim,  there  have  been  few  evaluation  studies  of  the  program's  effectiveness. 
Program  managers  have  expressed  concern  about  the  types  of  parents  who  attend  and 
whether  or  not  public  health  is  indeed  reaching  those  who  most  need  the  information 
(low  socioeconomic,  teen  and  first-time  parents)  and  if  not,  how  to  reach  high-risk 
parents.   In  addition,  administrators  need  to  know  if  parents  who  attend  prenatal 
education  sessions  actually  show  different  behaviors  and  understanding  than  do 
parents  who  have  not  had  prenatal  education. 

Evaluation  objectives  were  established  to  provide  specific  measurements  of  the 
prenatal  education  program's  effectiveness.   Each  objective  and  its  evaluation 
procedure  can  be  easily  modified  to  fit  individual  health  department  needs.   For 
example,  the  percentage  and  date  In  Objective  2  can  be  changed  to  fit  other  health 
department  needs. 

Each  objective  will  follow  the  same  format:   (1)  the  rationale  for  each  objective 
will  be  discussed,  (2)  its  methodology  will  be  detailed  and  explained  and  (3)  the 
use  of  data  by  administrators  will  be  suggested. 
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Objectives*  ^ 

1.  TO  DEMONSTRATE  BETTER  HEALTH  OUTCOMES  FOR  MOTHERS  WHO  HAVE  PARTICIPATED 

IN  THE  PRENATAL  EDUCATION  PROGRAM  THAN  DEMONSTRATED  BY  MOTHERS  WHO  HAVE  NOT 
ATTENDED  PRENATAL  EDUCATION  SESSIONS. 

2.  TO  REDUCE  COURSE  NO-SHOW  AND  DROPOUT  RATES  BY  40%   BY  JANUARY   1987. 

3.  TO  EFFECTIVELY  MEET  PARTICIPANT  INFORMATION  AND  SUPPORT  NEEDS  THROUGH 
PRENATAL  EDUCATION  COURSES. 

4.  TO  INCREASE  THE  NWIBER  OF  FATHERS  ATTENDING  COURSES  BY  50%   BY  JANUARY 
1981. 

5.  TO  DETERMINE  THE  COSTS  OF  PROVIDING  PRENATAL  EDUCATION  COURSES. 

Objective  1  To  demonstrate  better  health  outcomes  for  mothers  who  have  parti- 
cipated in  the  prenatal  education  program  than  demonstrated  by 
mothers  who  have  not  attended  prenatal  education  sessions. 

Rationale  -  This  objective  is  to  answer  the  bottom-line  evaluation  question 

"What  does  public  health  accomplish  by  offering  prenatal  education  sessions"? 

To  a  large  extent,  the  Prenatal  Education  Program  has  been  run  on  faith,  never 

knowing  whether  or  not  the  program  does  have  an  impact. 

Methodology  -  Working  closely  with  experts  in  the  maternal-child  health  field,  a     fe 

system  will  be  designed  to  fit  as  closely  as  possible  into  existing  at-risk         ^ 

scoring  methods.  A  score  will  be  given  to  mothers  who  (1)  have  and  (2)  have  not     co 

attended  prenatal  education  sessions,  based  upon  their  general  reactions  to  labor    ti 


and  delivery,  and  including  their  infants'  birth  weights,  length  of  stay  in  hospital, 
father's  participation  in  labor  and  delivery,  early  mother- infant  interactions,  etc.  ci 
Scores  will  be  compared  for  those  who  went  through  prenatal  education  and  those    fe; 
who  did  not,  in  order  to  determine  if  a  statistically  significant  difference  does    S 
indeed  exist. 

Use  of  data  -  Results  from  this  survey  will  provide  effectiveness  data  to  program 
managers  who  need  to  know  if  their  program  is  having  an  impact  on  mothers'  behaviors. 
With  this  information,  administrators  will  have  a  solid  basis  upon  which  to 
effectively  allocate  personnel  and  program  monies. 


Italics  indicate  that  percentages  and  dates  may  be  changed  to  reflect 
individual  health  department  needs. 
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Objective  2  To  reduce  course  no-show  and  dropout  rates  by  40%   by  January  7981. 
Rationale  -   a  considerable  scheduling  problem  can  occur  when  course  registrations 
fill  up,  and  only  half  of  the  potential  participants  actually  come  to  their 
sessions.   Similarly,  participants  who  drop  out  during  the  six  week  course  are 
taking  places  that  could  have  been  used  to  reach  more  people.   In  exploring 
reasons  for  both  no-shows  and  dropouts,  courses  can  be  better  designed  to  effi- 
ciently serve  as  many  people  as  possible. 

Methodology  -  Careful  record  of  course  sign-up  and  attendance  will  be  kept  in 
order  to  provide  baseline  data  against  which  to  measure  changes.   To  determine    ^^^ 
participants'  reasons  for  non-attendance,  phone  surveys  will  be  conducted  to      ^ 
determine  (1)  why  those  who  signed  up  for  prenatal  education  did  not  come  at  all   g 

and  (2)  why  participants  missed  two  or  more  sessions.  i 

I 
The  survey  will  be  designed  to  get  information  such  as:   number  of  children     ^ 

ki 

currently  in  the  family,  how  parents  learned  about  prenatal  education,  and  more    g^ 

o 

specifically,  why  they  did  not  attend,  what  they  expected  from  the  sessions,  if    g 

they  notified  the  Health  Department  that  they  would  not  attend  and  if  they  think 
they  would  be  interested  in  prenatal  education  later. 

Other  experiences  with  no-show  surveys  have  shown  that  the  type  of  people  who 
fail  to  show  for  appointments  and  clinics  probably  do  not  have  a  phone  in  service 
and/or  are  probably  transient.   Although  other  similar  surveys  have  been  successful 
in  determining  needed  information,  it  has  taken  considerably  longer  than  surveying 
a  "normal"  population. 

Use  of  data  -  Program  managers  who  have  information  on  failure  to  show  rates  will 
then  be  able  to  change  sign-up  procedures  and/or  course  design  to  best  deal  with 
their  particular  situation.   For  example,  if  the  no-show  rate  is  consistently 
40%,  then  it  would  be  efficient  to  over-schedule  by  60%  for  each  series  of  courses. 

Objective  3  To  effectively  meet  participant  information  and  support  needs 

through  prenatal  education  courses.  _^ 

Rationale  -   initial  measurements  of  satisfaction  have  shown  that  there  are  some   ^ 


parts  of  the  standard  course  outline  that  a  high  percentage  of  participants  do 
not  like  (family  planning,  for  example).   Further  development  of  satisfaction 
measures  will  show  other  parts  of  the  courses  that  can  be  expanded  or  reduced. 
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Methodology  -  Two  questionnaires  will  be  used,  the  first  to  determine  course 
participant  interests  and  the  second  to  evaluate  participant  satisfaction  with 
the  course  as  a  whole. 

The  course  interest  survey  will  give  a  list  of  possible  topics  of  interest 
to  new  parents  and  ask  respondents  to  rate  the  importance  of  the  class  on  a 
five-point  scale.   Initial  work  with  this  type  of  survey  has  shown  excellent 
results. 

The  second  survey,  the  participant  evaluation,  will  ask  Prenatal  Education 
course  participants  their  views  about  the  classes  they  just  completed  —  how 
they  found  out  about  the  program,  what  they  liked  best  and  least  about  the  course, 
how  they  rated  specific  topics  and  sociodemographic  information. 
Use  of  data  -  interestingly,  some  topics  considered  by  public  health  nurses  to 
be  important  to  parents  have  been  shown  to  receive  a  low  priority  by  course 
participants.   Those  topics  are  fetal  development,  the  reproductive  system  and 
family  planning.  Knowing  what  participants  want  from  courses  will  help  planners 
to  design  sessions  that  attract  and  hold  parents'  interest. 

Objective  4  To  increase  the  number  of  fathers  attending  courses  by  50%   by 

Jaunary   7987. 

Rationale  -  Preliminary  investigation  indicates  that  when  fathers  attend  Pre- 
natal Education  classes  with  their  partners,  there  is  a  direct  correlation  with 
participant  completion  of  the  six-week  course.   In  addition,  in  this  day  and 
age,  fathers  are  more  and  more  readily  accepting  responsibility  for  parenting 
and  are  wanting  more  information. 

Methodology  -  Attendance  sheets  will  be  kept  to  record  who  signs  up  for  each 
six  week  session,  how  many  sessions  they  attend  and  whether  or  not  both  partners 
come.   These  records  will  be  particularly  valuable  in  tracking  the  success 
of  efforts  to  increase  father  participation,  such  as  special  public  information   ^ 
and  use  of  course  materials  especially  emphasizing  fathers. 

Use  of  data  -  More  study  is  needed  to  determine  if  increasing  father  partici- 
pation also  increases  course- long  attendance  by  women  as  well.   Experiments 
showing  the  most  effective  manner  of  accomplishing  this  goal  can  then  be  used 
by  other  health  departments. 


A. 6 


6 


Prenatal  Education 
Evaluation  Plan 
Page  7 


Objective  5  To  determine  the  costs  of  providing  Prenatal  Education  courses. 
Rationale  -   Cost  data  is  cited  as  one  of  the  most  important  parts  of  the 
Community  Health  Services  Evaluation  Project.   A  clear  and  practicable  method 
of  determining  actual  costs,  both  direct  and  indirect,  will  make  accurate  data 
available  to  all  program  managers. 

Methodology  -  The  cost  determination  will  closely  follow  those  constructed  for 
the  other  evaluation  plans.   Those  worksheets  include  costs  of  personnel,  equip-  <^<l 
ment  and  materials,  travel,  training,  books  and  periodicals,  division  indirect    £s 
costs  and  health  department  overhead  costs.   A  complete  explanation  of  the       f-i 
methodology  is  part  of  the  worksheet  to  insure  consistency.  to 

Use  of  data  -  Efficient  allocation  of  resources  and  staff  time  depends  on  know- 
ledge of  program  costs  and  how  those  costs  compare  with  costs  of  other  programs. 
The  cost  worksheet  will  provide  data  in  a  readable  and  replicable  manner. 


Implications  of  Prenatal  Education  Evaluation 
The  Prenatal  Education  Evaluation  Plan  is  intended  to  be  used  by  health  de- 
partments to  meet  their  individual  data  needs  and  is  designed  to  be  a  general 
evaluation  of  a  public  health  program  that  may  vary  from  department  to  department. 
Missoula's  final  evaluation  results  will  be  made  available  to  any  health  de- 
partment who  would  like  to  use  the  data  for  comparison  or  reference. 

The  evaluation  methodologies  are  designed  to  be  continued  from  year  to  year 
in  order  to  track  changes  and  give  yearly  comparison  data.   As  staff  become 
familiar  with  the  evaluation  procedures,  use  of  employee  time  will  diminish. 

Because  of  the  limited  amount  of  existing  work  on  prenatal  education  program 
evaluation,  consideration  should  be  given  to  publishing  this  evaluation,  opening 
the  way  to  further  efforts  and  hopefully,  contributing  to  the  state-of-the-art. 
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INTRODUCTION 

Explanation  of  Evaluation  Project  -  This  Users'  Guide  demonstrates  five  ways  to 
evaluate  your  Home  Health  Program  —  from  a  new  home  health  nursing  audit  to  a 
survey  of  health  professionals  who  refer  to  home  health  care.   The  evaluation 
methodologies  are  a  result  of  the  two-year  Community  Health  Services  Evaluation 
and  Planning  Project,  conducted  from  1979  to  I98I  by  the  Missoula  City-County 
Health  Department. 

The  evaluation  project's  goal  is  to  provide  practical,  efficient  evaluation 
methods  that  public  health  administrators  can  use  when  evaluating  their  own 
programs. 

Scope  of  Home  Health  Program  Evaluation  -  Each  evaluation  methodology  is  designed 
to  fit  smoothly  into  your  health  department's  existing  programs  and  to  produce 
clear  and  immediately  useful  data.   Because  the  Missoula  Health  Department  was 
the  test  site  for  this  evaluation  model,  the  examples  shown  in  this  Guide  are 
based  on  Missoula's  programs  and  data.   You  may  need  to  modify  some  parts  of  the 
evaluation  to  fit  your  program's  features,  or  expand  the  evaluation  to  other 
types  of  similar  services. 

Home  health  evaluation  is  complicated  by  the  nature  of  the  program.   Evaluation 
measures  such  as  patient  satisfaction  surveys  can  be  unsatisfactory  because  they  are 
subjective.   Evaluation  measures  like  cost  comparisons  tend  to  be  incomplete 
because  they  cannot  measure  such  psychological  benefits  as  patients  being  able 
to  live  in  their  own  homes  and  maintain  a  measure  of  independence. 

Each  section  of  the  Guide  shows  Missoula's  test  results,  discusses  evaluation 
procedures,  details  evaluation  methodologies  and  provides  any  forms  used  to  collect 
data.   The  nursing  audit  and  referral  survey  are  copy-ready.   The  evaluations 
are  to  be  used  in  conjunction  with  Medicare  time/cost  studies  and  other  required 
federal  evaluations. 

Changes  from  Original  Evaluation  Plan  -  An  evaluation  plan  is  a  brief  outline  of 
proposed  work.   Several  parts  of  the  Home  Health  Evaluation  Plan  proved  to  be 
infeasible,  so  were  dropped  and  other  parts  were  changed.   Two  other  evaluations 
were  added. 

1.  Evaluation  Objective  1,  Referral  Log  —Changed.   We  felt  that  separate 
(original  plus  carbon)  referral  records  were  more  efficient.   The  original 
copy  can  be  routed  to  the  appropriate  nurse  and  the  copy  can  be  kept  in 

a  file  for  later  analysis.   A  log  would  contain  a  record  of  all  calls 
also,  but  it  would  not  provide  a  copy  for  the  nurse. 

2.  Evaluation  Objective  2,  Patient/Family  Survey  -   Found  ineffective.   We 
tried  two  types  of  surveys  —  the  first  was  sent  to  each  discharged  patient 
or  their  family,  if  the  patient  was  unable  to  complete  the  questionnaire 
(through  death  or  disability).   This  type  of  survey  took  so  long  to 
produce  results  that  we  dropped  the  idea  and  instead  tried  a  questionnaire 


sent  to  all  current  patients,   While  this  type  of  survey  worked  considerably 
better,  it  also  proved  to  be  ineffective.   The  main  problem  with  the  second 
survey  was  poor  response  to  several  individual  questions  and  a  marked 
reluctance  of  patients  to  give  constructive  criticism.   See  full  report  on 
Page  i  i  i .  ( 

3.   Evaluation  Objective  k,    "Average  Patient  Prof i le"  —  Dropped.   Further 
discussions  with  home  health  administrators  showed  that  they  felt  the 
information  from  Objective  h   would  be  nice,  but  not  really  useful. 
Medicare  cost  reports  are  felt  to  be  adequate  information, 

A.   "Alternate  Service  Survey"  added  (Section  2), 

5.   "Palmore's  Facts  on  Aging  Quiz"  added  (Page  ix).   It  is  interesting  to 
administer  this  questionnaire  to  home  health  staff  to  measure  their 
knowledge  and  attitudes  toward  the  senior  citizens.   Both  quiz  and 
answers  are  included. 


TO:   Jean  Pinsoneault,  Home  Health  Supervisor 
Crystal  Day,  Health  Services  Directo^ 

FROM:   Janice  Hand,  Research  Specialis 

RE:   Results  of  Home  Health  Patient  Survey 

DATE:   March  12,  1981 

Summary 

Results  of  the  Home  Health  Patient  Survey  primarily  show  that  50%  of  patients 
surveyed  asked  for  more  information,  especially  on  diet  and  nutrition,  how 
to  live  with  their  condition,  and  understanding  their  medications  better. 
Patients  also  said  that  they  would  use  various  in-home  services,  if  the  services 
were  available  (transportation,  visiting  services,  homemaker,  etc.,  are  currently 
available) .   Sixty-nine  percent  of  the  respondents  said  that  the  quality  of 
home  health  services  was  excellent.   In  general,  I  am  not  happy  with  the  results 
of  the  survey:   results  are  largely  inconclusive,  some  questions  are  plagued 
by  a  high  no-response  rate  and  few  respondents  wrote  constructive  comments. 

Survey  Methodology 

This  methodology  is  a  revision  of  the  first  survey  attempt  where  we  surveyed 
home  health  patients  (or  their  families)  after  their  cases  had  been  closed. 
That  attempt  failed  because  we  didn't  get  enough  questionnaires  back  in  the 
survey  time  period. 

The  new  methodology  reported  here  surveyed  all  patients  receiving  home  health 
care  during  the  first  week  of  January,  1981.   Seventy-six  questionnaires  were 
sent  out  and  52  were  returned.   After  adjusting  for  the  10%  (or,  approximately  7) 
whom  we  estimated  were  in  no  physical  or  mental  condition  to  fill  out  a  survey 
form,  the  return  rate  is  75%,  an  excellent  response  for  a  mail  survey. 

Results   -  Home  Health  Patient  Survey 

1.   If  home  health  had  not  been  available,  what  other  care  would  you  have  used? 

12%  hospital 

13%  nursing  home  care 

4%  day  care  or  homemaker 
15%  visit  doctor  more  often 
33%  none 
13%  other 
(10%)  no  response 
Generally,  respondents  mentioned  friends,  live- in  help  or  concerns  with  money 
if  they  had  been  unable  to  receive  home  health  care. 

Analysis:     This  question  is  comparable  to  the  Physician  Alternative  Care  Survey 
(1980) .   Results  show  different  perceptions  between  what  doctors  would  order 
for  alternative  care  and  what  care  patients  felt  they  would  have  used: 
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Physician  Alternative     Home  Health 
Service  Survey       Patient  Survey 

Hospital  7% 12% 

Nursing  home  care/rest  home  42% 13% 

Day  care  or  homemaker/live-in  help  20% 4% 

Visit  doctor  more  often  29% 15% 

None,  made  do  2% 33% 

Other  0% 13% 

(/I/O  Response)  (0%) (10%) 

Because  the  two  sample  sizes  are  very  similar  (n=52  and  69,  respectively),  and 
the  two  questions  were  asked  the  same,  you  may  directly  compare  results.  Pa- 
tients would  prefer  to  avoid  nursing  or  rest  home  care,  live- in  help,  and  vis- 
iting their  doctor  more  often  in  favor  of  making  do  or  making  other  arrange- 
ments.  The  differences  between  patients'  and  doctors'  perceptions  of  what 
other  form  of  care  they  would  prefer  to  use  are  striking. 

2.  Some  patients  have  said  they'd  like  to  get  more  information  about  certain 
topics.   Please  mark  any  topics  you  would  like  to  have  more  information 
about. 

35%  don't  feel  they  need  any  more  information 

15%  improving  nutrition  and  diet 

18%  living  with  their  condition  better 

11%  understanding  their  medications 

10%  other  (most  comments  asked  for  more  information  about  nutrition  and 

diet,  response  2) 
(11%  no  response) 

Analysis:      Fifty-four  percent  of  respondents  asked  for  more  information, 
compared  with  35%  who  felt  they  didn't  need  any  further  information.  This  re- 
sult is  significant  because  it  is  a  clear  indication  that  many  patients  are 
not  receiving  enough  information  and  are  asking  for  information  related  to 
their  health:   how  to  better  live  with  their  condition,  improving  their  nutri- 
tion and  diet,  and  understanding  their  medications  better.   Research  in  communication 
and  learning  shows  that  verbal  presentations  alone  result  in  approximately  20% 
recall  or  recognition  over  several  weeks,  but  verbal  plus  visual  reinforcement 
leads  to  40%  recall.   Then,  if  verbal,  visual  and  reinforcement  (or  re-introduction 
of  the  topic)  is  used,  there  is  a  60%  recall.  This  research  indicates  that 
pamphlets,  worksheets,  information  outlines  and  the  like  could  be  solutions 
to  problem  pointed  out  by  Question  2, 

3.  Please  check  any  services  you  are  not  receiving  now,  but  would  use  if 
available. 

15%  rides  to  do  shopping,  errands,  and  see  the  doctor 

2%  delivered  hot  meals 

3%  radio  reading  services  /! 

11%  friendly  visiting  services  AV 

6%  physical  or  speech  therapy 

3%  nursing  care  not  covered  by  home  health 

10%  homemaker  to  help  with  cleaning,  shopping  and  chores 

8%  other  (these  comments  were  unrelated  and  no  conclusions  can  be  drawn) 

{42%)  no  response)  iv 
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Analysis:     Patients  said  their  prime  needs  are  for  transportation,  friendly 
visiting  services,  and  homemaker  services,  all  of  which  are  in-home  services 
currently  offered  in  Missoula.   The  extremely  high  no-response  rate  is  probably 
due  to  the  number  and  length  of  responses  and  the  visual  image  of  a  long 
column  of  boxes.   I'm  very  disappointed  in  these  results. 

4.  All  in  all,  how  would  you  describe  the  quality  of  home  health  services? 

69%  excellent 
23%  good 

6%  poor 

0%  very  bad 

Analysis:     Rocheleau  and  Mackesey  pointed  out  in  their  article  "What,  Consumer 
Feedback  Surveys  Again?"  (in  Evaluation  and  the  Health  Professions,  December 
1980),  that  most  clients,  an  average  of  75%,  tend  to  be  satisfied  with  services. 
They  point  out  that  failure  to  get  a  reasonable  satisfaction  level  of  70-75% 
is  an  indication  that  a  problem  exists  with  the  agency's  programs.   With  that 
argument  in  mind,  the  69%  response  to  excellent  quality  of  home  health  services 
could  be  improved.   Unfortunately,  the  questionnaire  does  not  provide  any 
answers  to  where  the  quality  of  home  health  services  should  be  improved. 

5.  We  try  to  make  home  health  an  effective  program,  but  realize  improvements 
are  always  possible.   Please  help  by  making  suggestions  to  improve  home 
health  services. 


Respondent  Suggestions: 


"Sometimes  the  woman  who  aomes  once  a  week  to  go 
shopping  is  siak  -  they  should  have  a  baak-up. 
So  far  though  there  has  not  been  a  problem.  " 

"Our  older  people  need  more  qualified  nurses  to 
look  in  on  them  from  time  to  time  -  although 
is  a  darling.  " 


"Mental  health  aounseling. " 

"Well,  if  I  just  had  lots  more  of  the  money  so  I 
could  buy  needed  things  around  the  place  it  sure 
would  be  lovelier  living  around  here.  " 


"An  emergency  nurse  -  to  call  day  or  night.     I'm 
paraplegic  and  sometimes  have  accidents  in  bed 
and  need  help  cleaning  up. " 

"More  range  in  help  at  home. " 

"I  sure  do  wish  I  could  get  my  medical  and  food 
stamps  cause  I  will  be  dead  shortly  if  they  don't 
do  something  to  help  me." 


J.  Pinsoneault 
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5.   (cont.) 

Respondent  Suggestions! 


"If  the  nurse  aould  oome  more  often. " 

"I  am  irritated  because  I  aan't  drive  anymore 
and  do  need  transportation  monthly  to  the 
doctor. " 


Respondent  Compliments : 


"My  part  J   I  have  no  improvements.     I  think  you 
a:re  doing  fine  for  me  and  my  sister.  " 


"As  of  to  date  it's  excellent." 

"We  appreciate  the  help  you  offer  so  we  can  get  away 
and  don't  have  any  neu  ideas  at  this  time.     Just 
keep  up  the  good  work  you  are  providing. " 

"I  think  home  health  services  is  a  fantastic 
program.      I  am  very  pleased  with  it." 

"I  don't  knaWj   I'm  satisfied  as  it  is." 


"I'm  perfectly  satisfied  with  the  services  I 
am  receiving. " 

"I  am  80  years  5  months  in  age.     For  my  condition 
I  am  receiving  visits  from  Home  Health  nurses  which 
I  could  not  do  without.     The  care  I  receive  is 
excellent  and  friendly.     I  don't  know  how  I 
could  make  it  if  it  didn't  exist.     Thank  you. 
My  ailments  are  stroke ^   neuro  demitius  and  age. " 

"Very  pleased  with  the  program.      Our  nurses  are 
excellent.     Also  have  enjoyed  working  with  Dr. 
McCarthy. " 

" has  been  an  angel ,  we  love  her,   she  is  very 

good  at  her  work  and  shows  a  lot  of  loving  care  to 

everyone.     is  a  very  special  lady  and  excellent 

nurse. " 


''Highest  praise  for  work  done 


and 


Not  only  what  they  do,   but  their  cheerful  and 
encouraging  attitudes. " 

" was  very  pleasant  and  considerate. " 


"From  all  the  good  I  hax>e  heard,   how  pleased  I 
am  as  a  whole,   at  this  time  I  could  not  make  good 
suggestions.     It  is  a  wonderful,  wonderful  program       ^ 
and  God  Bless  and  thank  you  all."  ^ 


vl 
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5.   (cont.) 

Respondent  Compliments: 


"J  don't  see  that  they  can  he  improved." 

"I  think  your  services  are  wonderful  and  your 
nurses  are,    too.     Vlease  excuse  my  mistakes.     I 
am  so  nervous.      I  enjoy  your  visits." 


''OK  so  far. 


"The  nurses  are  so  helpful  and  pleasant  and  have 
helped  me  so  much  dressing  that  wound  and  helping  with 
my  hath.     I  really  don't  know  what  I  would  have 
done  without  them. " 


"Everything  OK. " 

Analysis:     These  comments  primarily  center  around  asking  for  more  services 
and  perceiving  the  nurses  as  helpful,  cheerful,  encouraging,  etc.,  but  only 
one  mention  was  made  of  their  professional  status  and  role. 

Survey  Recommendations 

Although  the  survey  does  give  some  good  information,  I'm  not  happy  with  it.   The 
survey  shows  that  we  were  right  to  keep  the  survey  short  and  easy  to  complete, 
but  even  then,  the  no-response  rate  to  Question  3  is  very  high.   The  survey 
doesn't  give  complete  information  to  questions  it  raises:   why  did  31%  of  the 
respondents  give  quality  of  home  health  care  a  lower  than  "excellent"  rating? 
How  should  quality  be  improved?   In  retrospect,  I  do  not  recommend  that  mail 
surveys  be  used  for  home  health  program  evaluation.   1  believe  personal  or 
phone  interviews  would  have  been  much  more  effective. 


JSH/slp 
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I  PALMORE'S  (1977)  FACTS  ON  AGING  QUIZ 

T  F  1.  All  five  senses  tend  to  decline  in  old  age. 

T  F  2.  The  majority  of  old  people  feel  miserable  most  of  the  time, 

T  F  3.  Most  old  people  have  no  interest  in,  or  capacity  for,  sexual  relations. 

T  F  4.  Physical  strength  tends  to  decline  in  old  age. 

T  F  5.  Most  older  workers  cannot  work  as  effectively  as  younger  workers. 

T  F  6.  In  general,  most  older  people  are  pretty  much  alike. 

T  F  7.  The  majority  of  old  people  are  socially  isolated  and  lonely. 

T  F  8.  At  least  one-tenth  of  the  aged  are  living  in  long-stay  institutions  (i.e. 
nursing  homes,  mental  hospitals). 

T  F  9.  Old  people  usually  take  longer  to  learn  something  new. 

T  F  10.  The  majority  of  old  people  are  seldom  bored. 

jj"  F  11.  The  reaction  time  of  most  older  people  tends  to  be  slower  than  the  reaction 

"  time  of  younger  people. 

T  F  12.  The  majority  of  old  people  (past  age  65)  are  senile. 

T  F  13.  Lung  capacity  tends  to  decline  in  old  age. 

T  F  14.  Aged  drivers  have  fewer  accidents  per  person  than  drivers  under  age  65. 

T  F  15.  About  80%  of  the  aged  are  healthy  enough  to  carry  out  their  normal  activities. 

T  F  16.  Most  old  people  are  set  in  their  ways  and  unable  to  change. 

T  F  17.  It  is  almost  impossible  for  most  old  people  to  learn  new  things. 

T  F  18.  Older  workers  have  fewer  accidents  than  younqer  workers. 

T  F  19.  Older  people  tend  to  become  more  religious  as  they  age. 

T  F  20.  The  health  and  socioeconomic  status  of  older  people,  (compared  to  younger 
people  in  the  year  2000)  will  probably  be  about  the  same  as  now. 


T  F  21.  Over  15%  of  the  U.S.  population  are  now  age  65  or  over 

1 

i 


T  F  22.  The  majority  of  older  people  have  incomes  below  the  poverty  level  (defined 
by  the  Federal  government). 
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T  F  23.  Most  medical  practitioners  tend  to  give  low  priority  to  the  aged. 

T  F  24.  The  majority  of  old  people  are  working  or  would  like  to  have  some  kind  of 
work  to  do  including  housework  and  volunteer  work. 

T  F  25.  The  majority  of  old  people  are  seldom  irritated  or  angry. 


(^ 


PALMORE'S  (1977)  FACTS  ON  AGING  QUIZ 
ANSWERS 


1. 

2. 

3. 

4. 

1 

S. 

6. 

7. 

8. 

,9. 

10. 

u. 

12. 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20. 

21. 

22. 

23. 

24. 

25. 

SECTION  1 
NURSING  AUDIT  SPECIALLY  DESIGNED  FOR  HOME  HEALTH  PROGRAMS 


Results  -  The  new  home  health  audit  tool  replaces  a  general  nursing  audit  formerly 
used  by  the  Missoula  Home  Health  Agency  and  many  others  in  Montana.   The  new  audit 
has  been  tested  and  revised  after  being  used  during  a  regular  audit  of  first 
quarter  198I,   The  audit  summary  showed  that  of  audited  records,  55%  were  rated 
excellent,  l8%  good,  ^S%   fair  and  3%   were  rated  poor. 

Discussion  ■-  We  sent  out  inquiry  letters  to  approximately  120  home  health  agencies 
around  the  country  and  received  about  50  audit  forms  to  review.   A  group  of  home 
health  administrators,  supervisors,  nurses  and  an  evaluator  reviewed  each  audit 
and  found  that  the  basic  Phaneuf  model  was  the  most  complete.   Although  the  Phaneuf's 
major  fault  is  that  it  does  not  cover  nursing  care  specific  to  home  health  services, 
the  group  felt  that  it  held  the  most  promise  for  revision. 

The  audit  was  revised  to  insure  that  it  (I)  completely  covers  all  measures  of 
nursing  quality  found  in  the  "usual"  home  health  case;  (2)  measures  both  quality 
of  nursing  care  and  quality  of  reporting  and  recording;  (3)  reflects  the  basic 
ideology  of  home  health  care  (promote  independent  living  for  patients);  (A)  is 
easily  interpreted  consistently  by  all  auditors;  and  (5)  gives  points  only  when 
it  can  be  clearly  proven  from  the  record  that  a  nursing  action  took  place. 

Methodology  -  The  audit  form  is  to  be  completely  filled  out,  keeping  the  basic 
philosophies  above  in  mind.   The  audit  methodology  should  follow  Medicare 
requirements,  just  as  with  the  other  audits. 
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MISSOULA  CITY-COUNTY  HEALTH  DEPARTMENT 
HOME  HEALTH  AUDIT 

'This  data  must  be  held  in  STRICT  confidence  and  must  not  be  filed  with  patient's  record. 


PART  1  -  Tu  be  complete 

d  by  clerk. 

Patient  Name/Last 

First 

Age 

Date  Admitted 

Date  Discharged 

Nursing  Agency 

Number  of  Visits 

Complete  Diagnoses 


Was  patient  hospitalized  immediately 
prior  to  home  health  care? 

I  I  yes  — •>  number  of  days 

□  no 

I     I  unknown 


Referred   by: 

[^discharge   planner  [^patient's    farril 

□  self  □other: 

I     I  doctor  


Discharged    to: 

□  self-care     □family-care     □hospital     □  died     □[other   agency     |     |  unknown 

□  Other: 


PART  2 


To  be  completed  by  nursing  audit  committee. 


Record  reflects  service  as; 


excel  lent 


good 


fai  r 


□  excellent  i — i  gooa      i — r  lair      i — i  poor      i — i  very  poor  i — i  record  does  not 
[llk-lOk)     1—1  (203-183)  1—1  (182-162)  I— I  (161-141)  LJ  (<  litO)   LJpermit 


eva I uat ion 


Audit  Committee  Comments: 


Auditor's  Signature 


CAREPROVIDER(s)  SUPERVISED  AND  COORDINATED 

YES   NO   DNA  COMMENTS 

1.  Patient  and/or  careprovi ders 
demonstrated  appropriate  care 
as  taught  by  RN.  5    0    5   


RN  had  considered  patient's 
and/or  careproviders '  physical, 
emotional  and  mental  capacity 
to  learn. 

RN  rendered  physical  and 
emotional  support  of  patient 
and/or  careproviders  during 
learning  process  and  provision 
of  care. 

RN  continued  supervision  of  car 
and  procedures  taught. 

RN  coordinated  services  by  RN, 
Aide,  LPN,  and  other  care- 
providers. 

Need  for  community  resources 
evaluated,  referrals  made  as 
appropriate,  and  follow-up 
documented. 


REPORTING  AND  RECORDING 


m 


Record  shows  pertinent  com- 
munication with  doctor. 

Patient  or  careproviders  alerted 
about  information  to  be  reported 
to  doctor. 

Care  plan  completed,  updated, 
and  clear. 


k. 

Al 1  entries  dated  and  in 

chronological  order. 

2 

0 

5. 

Record  legible  and  signed  by  RN, 

indicating  approval  of  content. 

2 

U 

6. 

Periodic  reassessment  and  nursing 

care  plan  revised  as  appropriate. 

2 

0 

7. 

Patient-family/support  relationsh 

ip 

described. 

2 

u 

SOAP  method  of  reco 
appropriately  used. 

Discharge  summary  i 
-date  open 
-referral  source 
-major  problem 
-intervention 
-patient  condition 
-reason  for  termina 
-date  closed 


'ding 


di  scharge 
?n  of  service 


CD 
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F.  PROCEDURES  AND/OR  NURSING  JUDGMENT  AND  TECHNIQUES  APPLIED  AND  EXECUTED 


RN  reviewed,  administered,  and/or 
supervised  medications. 

RN  assigned  and  careproviders 
showed  appropriate  attention 
to  patient's  personal  care  needs. 

Nutrition  noted  and  nursing 
intervention  as  indicated. 

RN  acted  to  prevent  complications 
and  infections. 

Elimination  noted  and  nursing 
intervention  as  indicated. 

Rest  and  sleep  noted  and  nursing 
intervention  as  indicated. 

Physical  activity  noted  and 
nursing  intervention  as 
indicated. 

Results  of  urinalysis,  vital 
signs,  or  other  tests  by  RN 
documented. 


Patient  care 
and  evaluatic 

Equipment  and  medical  supply  use 
documented . 


k  0 
A  0 
k  0 
TOTAL 


DNA  COMMENTS 


CD 


PATIENT'S  SELF-CARE  AND/OR  INDEPENDENT  LIVING  PROMOTED 

YES  NO  DNA  COMMENTS 

1.   Patient  and/or  careproviders  have 
plan  for  medical  and  environmental 


emergency. 


(Call  911). 


RN  prepared  patient  to  evaluate 
own  signs  and  symptoms  for  self- 
referral  to  appropriate  medical 
provider  as  necessary.  7 

RN  prepared  careproviders  to 
evaluate  patient  for  referral  to  ap- 
propriate med.  care  as  necessary.  7 

RN  taught  patient  and/or  care- 
providers appropriate  preventive 
health  practices.  7 

RN  taught  patient  and/or  care- 
providers appropriate  use  of 
community  resources  to  lead  to 

increased  level  of  patient's 

i  ndependent  1 i  v  i  ng . 


7    0 
TOTAL 


ru 


A 

B 

C          D 

E 

F 

G 

TOTAL 

Revised  5/8l 
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MISSOULA  CITY-COUNTY  HEALTH  DEPARTMENT/HOME  HEALTH  AGENCY 
HOME  HEALTH  NURSING  AUDIT 


Number  of  Records 
Rev  i  ewed 


Overal 1  Evaluation 
by  Number  of  Cases 


Eval uat  ion  by  Nursing 
Function  and  Number 
of  Cases 

A.  Doctor's  orders 
applied  and  executed. 

B.  Signs,  symptoms  and 
reactions  observed. 

C.  Patient  care 
supervi  sed. 

J).   Careprovider  (s) 
P   supervised  and 
coordinated. 

E.  Reporting  and 
recording. 

F.  Procedures  and/or 
nursing  judgment 
and  techniques 
applied  and  executed. 

G.  Patient's  self-care 
and/or  independent 

1 i ving  promoted. 


□ 

Kcel le 

□      □ 


Excellent     Good 


Fai  r 


Poor 


date 


Record  does 
not  permit 
Very  Poor  evaluation 


n  n  □  □ 


Record  does 


Excel  lent 

Good 

Fair 

Poor 

Very 
Poor 

not  permit 
evaluation 

Total 

Pi  rections: 

Using  the  scoring  system  below,  assign  each  function  of  each  record  to  the  appropriate 
category.   The  results  will  give  you  an  overall  audit  summary  and  weak  and  strong  areas 
will  be  more  apparent. 


Function 

Excel  lent 

Good 

Fair 

Poor 

Very  Poor 

A 

25 

20 

15 

10 

5-0 

B 

kS-k} 

40^33 

32-25 

24-17 

16-0 

C 

28 

2A 

20 

16-12 

8-0 

D 

30 

25 

20 

15 

10-0 

E 

18 

16-1A 

12-10 

8-6 

k-0 

F 

40 

36-32 

28-2A 

20-16 

12-0 

G 

35 

30 

25 

20-15 

10-0 

SECTION  2 

'alternate  service  survey' 


Results  -  The  Home  Health  "Alternate  Service"  study  shows  that  if  home  health 
services  had  not  been  available,  physicians  would  have  wanted  (in  order  of 
preference):  (l)  extended  or  more  frequent  office  visits,  (2)  nursing  or  rest  home 
care,  or  (3)  live-in  help  for  the  patients  the  survey  covered.   From  April,  1979 
to  May,  1980,  a  short  survey  was  mailed  to  physicians  with  routine  requests  for 
doctor's  orders,  asking  about  their  patients  on  home  care.   Results  of  the  survey 
indicated  physicians  preferred  home  health  care  to  extended  or  more  frequent  office 
visits  or  nursing/rest  home  care. 

Discussion  -  The  survey  was  conducted  to  find  out  what  services  doctors  would  have 
ordered  if  home  health  care  had  not  been  available  to  their  patients  already  on 
home  health  care.   The  survey,  then,  does  not  find  out  why  doctors  chose  home 
health  care  instead  of  alternate  forms  of  care  and  should  not  be  interpreted  for 
long-term  or  intermediate  care  patients  in  general,  but  for  home  health  patients 
only. 

Methodology  -  Because  physicians  are  notorious  for  their  aversion  to  paperwork, 
we  used  only  a  very  short  form  (page  2.4).   The  survey  form  plus  a  letter  of 
explanation  was  enclosed  in  home  health  agency  requests  for  doctor's  orders. 
Mid-way  through  the  survey  period  we  mailed  each  participating  physician  a  letter 
asking  them  to  please  continue  to  help  with  the  survey  (page  2.6).   When  the 
survey  was  completed,  each  physician  received  a  short  feedback  report  (page  2.7). 

The  survey  is  easy  to  administer  and  equally  easy  to  tabulate.   A  full  report  is 
!    shown  on  page  2.2  and  all  forms  and  letters  are  included. 
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...MAKING  A  DIFFERENCE. 


Home      Health 
Alternate  Service  Report 


Summary 

The  Home  Health  "Alternate  Service"  study  shows  that  if  home  health  services 
had  not  been  available,  physicians  would  have  wanted  (in  order  of  preference): 
(1)  extended  or  more  frequent  office  visits,  (2)  nursing  or  rest  home  care,  or 
(3)  live-in  help  for  the  patients  included  in  the  survey.   From  April,  1979  to 
May,  1980,  a  short  survey  was  mailed  to  physicians  asking  about  their  patients 
on  home  care.   Results  of  the  survey  indicated,  for  those  patients  in  the  study, 
physicians  preferred  home  health  care  to  extended  or  more  frequent  office  visits 
or  nursing/rest  home  care.   This  survey  will  be  followed  by  personal  interviews 
with  physicians,  discharge  planners  and  others  to  determine  how  many  and  what 
type  of  patients  are  not  referred  to  home  health  care  and  why. 

Purpose  of  Study 

A  good  many  studies  have  been  done  to  determine  the  cost-effectiveness  of 
home  health  care,  but  no  studies  are  available  to  answer  another  question  — 
"If  home  health  had  not  been  available,  what  alternative  service  would  have 
been  needed  by  the  patient?"  The  answer  to  that  question  gives  an  idea  of 
alternate  care  patterns,  as  well  as  whether  diagnoses  or  time  needed  on 
long-term  care  was  a  factor  in  chosing  home  health. 

Methodology 

For  physician  convenience,  a  half-page  form  was  designed  to  be  quickly  and 
easily  completed  by  only  two  checkmarks.   The  form,  attached  to  all  new 
patient  care  orders  along  with  a  short  letter  explaining  the  study,  asked 
physicians  to  check  one  of  seven  categories  of  alternate  care.   (For  form, 
see  attached. ) 


MI5S0UW  CIIY-COUNIYHEALIH  DEPARTMENT 

30)  WE5T  ALDEIR  STREET     AliSSOiLA.m  57601 
TnrPHONE     721-5700 
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Home  Health 

Alternate  Service  Survey  Report 
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Half-way  through  the  study,  a  letter  was  mailed  to  physicians  thanking  them 
for  their  help,  giving  some  preliminary  results,  and  asking  for  their  continued 
cooperation  during  the  study.   The  return  rate,  fairly  consistent  throughout 
the  study,  was  56%. 


Results 


ri 


Results  were  tabulated  in  two  ways  to  show  results  per  patient  and  per 
response  because  some  survey  forms  showed  more  than  one  of  the  seven  categories 
checked.    Sixty  eight  survey  forms  were  returned. 


In  order  of  preference,  extended  or  more  frequent  office  visits,  nursing 
home,  live-in  help,  rest  home,  and  hospital  care  were  cited  as  services  that 
would  have  been  ordered  if  home  health  care  were  not  available.   Lengths  of 
time  needed  for  the  alternate  service  as  reported  by  physicians  varied  from 
"one  more  office  visit"  to"an  indefinate  period* of  time  (all  forms  of  care  but 
hospitilization) . 


'If  Home 
Health 
Had  Not 
Been 

Avai lable, 
What 
Service 
Would 
You  Have 
Wanted?" 


Extended/More  Frequent  Office  Visits 

Live-In  Help 

Rest  Home 

Nursing  Home 

Hospiti 1 ization 

Wibed 

5% 


10^ 


15% 


10% 


25% 


30% 


Whan  diagnoses  were  grouped  and  examined  for  length  of  service  and  type  of 
service,  no  conclusions  could  be  drawn  that  patients  with  certain  diagnoses 
were  referred  to  home  health  or  would  have  been  on  alternate  forms  of  services 
for  any  set  period  of  time. 


Conclusions 


This  study  showed,  of  those  cases  where  physicians  preferred  home  health  care 
to  other  forms  of  care,  home  health  was  preferred  over  five  other  forms  of 
services.   The  study  does  not  explore  reasons  why  other  patients  were  not 
referred  to  home  health  care  (control  group) .   Another  survey  is  planned  to 
determine  why  some  patient  are  referred  to  home  care  and  others  are  not. 
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S.  Hand 
Research  and  Evaluation 


^ 


TELEPHONE    721-5700,    ext.    363  ^^^^  ^  EVMBATION  UNIT 

MISSOULA  CITY-COUNTY  HEALTH  DEPARTMENT 

301  WEST  ALDER  STREET 
MISSOULA,  MONTANA  59801 

RE:   your  patient  


Please  answer  yyith  the  -patient 's  condition  in  mind  as  of  today _ 


J 


If  Hone  Health  Services  had  not  been  available,  vdiat 
service  would  you  have  wanted  for  this  patient? 

I  t hospitilization  estimated  length  of  time  

I  I  nursing  home estimated  length  of  time  

I  I  rest  hcane estimated  length  of  time  

I  I  live-in  help estimated  length  of  time  

I  I  extended/more  frequent  office  visits  .  .  estimated  length  of  time  

I  [  none  needed estimated  length  of  time 

I  I  other;  please  explain  estimated  length  of  time 

THANK  YOU! 

TELEPHONE  721-5700   ext.    363 

RESEARCH  AND  EVALUATION  UNIT 

MISSOULA  CITY-COUNTY  HEALTH  DEPARTMENT 

301  WEST  ALDER  STREET 
MISSOULA,  MONTANA  59801 

RE:  your  patient 


Please  answer  with  the  patient 's  condition  in  mind  as  of  today 


If  Hone  Health  Services  had  not  been  available,  what 
service  would  you  have  wanted  for  this  patient? 

1  I  hospitilization  estimated  length  of  time 

I  I  nursing  home estimated  length  of  time 

I  I  rest  home  estimated  length  of  time 

I  I  live-in  help estimated  length  of  time 

I  I  extended/more  frequent  office  visits  .  .  estimated  length  of  time 

I  I  none  needed estimated  length  of  time 

I  I  other;  please  explain  estimated  length  of  time 

THANK  YOU  I 


^r 


(f 


(( 


TELEPHONE  728-4510 


MISSOULA  CITY-COUNTY  HEALTH  DEPARTMENT 

301  WEST  ALDER  STREET 


^  MISSOULA,  MONTANA  59801 


Your  help  with  the  attached  question  is  important  to  the  evaluation  and 
improvement  of  home  health  services  in  Missoula  County.   The  results  of  this 
ongoing  study  will  benefit  both  patients  and  health  care  professionals  through 
constant  monitoring  of  our  home  health  activities.  «- "-"uga 

^H^V^^ri^  ''^'^'  ^°"  ^^^  ^^^"^  '^^^  ^^°"  ^°"°  ^^  completed  and  returned  to 
the  Health  Department  with  the  patient's  care  plan.  You  should  receive  this 
blue  form  each  time  you  refer  a  patient  to  us. 

If  you  have  any  questions,  please  feel  free  to  call. 

Sincerely, 


Janice  S.  Hand 
Research  Specialist 


JSH/j 

End.  HH  Question 
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.MAKING  A  DIFFERENCE... 


December  14,  1979 


0^  "^^ 


^.o^- 


n^** 


Your  continued  help  in  completing  the  "Home  Health  Alternative  Service" 
form  (sample  attached)  has  been  instrumental  in  providing  important  data  for 
planning  our  services. 

The  survey  is  approximately  three-quarters  complete  and  we  anticipate  it 
ending  in  March,  1980.  Please  continue  to  complete  the  forms  and  return  them 
with  the  patient  care  plan  as  you  have  been  doing^  You  will  receive  a  copy 
of  the  results  summary  when  it  becomes  availab'e. 

We  appreciate  you  helping  us  in  this  survey  —  we  are  pleased  to  be  able 

to  examine  our  program  in  order  to  be  able  to  serve  you  and  your  patients 

better.  If  you  have  any  questions  or  comments  about  Home  Health  care,  please 
call  us  at  721-5700,  extension  357. 

Sincerely, 


Crystal  Day,  RN,  FNC 
Director  of  Nursing 


cd/JSH/j 
attachment 


MI5S0UWCI1Y-C(XJNIYHEAL1H  DEPARTMENT  C^ 

301  WEST  ALDER  STREET      MISSOULA,m  5?eOI 
TELEPHONE     721-5700 
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August  20,  1980      ,^ 


TO: 


^^^ 


FROM:  Crystal  Day,  RN,  FNC,  Nursing  Director  ^^ 
Janice  S.  Hand,  Research  Specialist 

RE:    Home  Health  Alternate  Service  Report 

As  promised,  here  is  a  copy  of  the  "Home  Health  Alternate  Service"  report 
based  on  data  that  you  and  other  physicians  provided  by  completing  the 
"Alternate  Service"  form  (copy  below) . 

The  report  shows  that,  if  home  health  services  had  not  been  available, 
physicians  would  have  wanted  -  (1)  extended  or  more  frequent  office  visits, 
(2)  nursing  or  rest  home  care,  or  (3)  live-in  help  -  for  their  patients 
surveyed. 

Thank  you  -  your  help  led  to  the  success  of  the  Home  Health  Alternate  Service 
study.   We  appreciate  your  input. 


TELEPHONE    721-5700,    ext.    363  SEARCH  AND   EVALUATION  UNIT 

MISSOULA  CITY-COUNTY  HEALTH  DEPARTMENT 

301  WEST  ALDER  STREET 

MISSOULA,  MONTANA  S9801 

RE:  your  patient  


Fleaee  anauer  with  the  patient 's  condition  in  mind  aa  of  today _ 


If  Home  Health  Services  had  not  been  available,  what 
service  would  you  have  wanted  for  this  patient? 

I   I  hospitilization estimated  length  of  time 

I   I  nursing  hone estimated  length  of  time 

I   i  rest  home estimatwJ  length  of  time 

I   I  live-in  help estimated  length  of  time 

I   I  extended/more  frequent  office  visits  .  .   estimated  length  of  time 

I   I  none  needed estimated  length  of  time_ 


I   I  other;  please  explain  estimated  length  of  tin 

THANK  YODI 
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SECTION  3 
REFERRAL  SURVEY  -  PHYSICIANS  AND  DISCHARGE  PLANNERS 


Results  -  The  single  most  important  conclusion  that  can  be  drawn  by  the  Referral 
Survey  is  that  physicians  do  not  fully  understand  home  health  care.   There  appears 
to  be  a  strong  need  for  a  comprehensive  public  relations  program  with  physicians, 
their  nurses,  other  agencies  and  the  public  to  acquaint  them  with  not  only  home 
health  services,  but  other  types  of  in-home  services.   The  survey  also  shows  that 
physicians  and  discharge  planners  overwhelmingly  felt  there  is  a  need  for  the 
home  health  agency  in  Missoula,   Respondents  said  that  continuity  of  care, 
health  teaching  for  independent  living  and  skilled  nursing  care  were  the  most 
important  and  useful  services  offered  by  home  care. 

The  Missoula  Home  Health  Agency  used  the  information  from  this  survey  to  revise 
their  public  service  announcement  program  and  to  plan  a  forum  for  physicians  and 
other  health  care  professionals  to  inform  them  of  home  care  available  in  Missoula. 

Discussion  -   Because  physicians  and  hospital  discharge  planners  refer  the  majority 
of  home  health  patients,  they  were  the  survey  population.   The  survey  was  administered 
to  three  groups  of  doctors  —  (l)  a  sample  of  those  who  refer  often,  (2)  a  sample  of 
those  who  refer  at  times,  and  (3)  a  sample  of  physicians  who  do  not  refer  patients 
to  home  health  care.   Discharge  planners  from  all  three  Missoula  hospitals  were 
surveyed. 

To  insure  a  good  response  and  complete  results,  the  survey  should  be  administered 
by  personal  interviews.   If  your  department  does  not  have  an  experienced  survey 
interviewer  to  conduct  the  survey,  we  recommend  that  you  hire  one.   Personal 
interviews  are  difficult  to  conduct  effectively  when  responses  are  subjective, 
as  they  are  in  this  survey.   The  interviewer  must  know  when  to  tactfully  probe 
for  more  information  if  a  respondent  hesitates  or  looks  doubtful. 

Surveys  like  this  one  have  the  additional  benefit  (other  than  information)  of 
involving  physicians  and  discharge  planners  with  the  program  and  opening  avenues 
of  communication  with  the  health  department. 

Methodology  -   Each  interview  took  approximately  15  minutes.   We  telephoned  each 
respondent's  office  for  an  appointment  and  briefly  explained  the  purpose  of  the 
visit.   At  the  beginning  of  the  interview  the  surveyor  fully  explained  the  survey 
and  its  purpose  and  stressed  that  the  respondent's  answers  must  be  frank  in  order 
for  the  survey  to  be  useful. 

The  following  are  important  points  to  follow  to  insure  an  accurate  survey: 

1.  Sample  Size  -  Optimally,  you  should  interview  all  discharge  planners, 
doctors  who  refer  often,  doctors  who  refer  at  times  and  doctors  who 
do  not  refer  at  all.   If  that  is  impossible,  select  the  largest  sample 
it  is  possible  for  you  to  do.   (Missoula's  survey  covered  15  respondents.) 


Section  3,  Page  1 


2.  Interviews  -  Be  prompt;  you  are  using  some  of  the  respondent's  business 
time.   Establish  rapport  before  starting  the  survey  —this  will  help  insure 
honest  and  frank  responses.   Read  each  question  exactly  as  it  is  written  to 
insure  that  responses  are  based  on  consistent  questions  from  interview  to 
interview.   Be  sure  to  probe  any  answers  where  the  respondent  hesitates  or 
seems  to  have  more  to  say.  Thank  the  respondent  for  his/her  time  at  the 
end  of  the  survey. 

3.  Tabulation  -  The  survey  is  fairly  easy  to  tabulate,  although  it  will  be 
important  to  carefully  categorize  responses  to  open  questions  (1,2,^,7, 
9,10)  to  reflect  respondent's  actual  comments. 


O 


(L. 
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TO:  Jean  PinsoneauU 

Home  Health  Nur^irv^Supervisor 

FROM:  Janice  S.  Ha' 
Research  Spec 

DATE:  February  17, 

RE:  HOME  HEALTH  REFERRAL  SURVEY 

Summary 

The  single  most  important  conclusion  which  may  be  drawn  by  this  survey  is 
that  physicians  do  not  fully  understand  home  health  care.   I  believe  there 
is  a  strong  need  for  a  comprehensive  public  relations  program  with 
physicians,  nurses,  other  agencies  and  the  public  to  acquaint  those  groups 
with  not  only  the  Health  Department's  Home  Health  Agency  and  its  function, 
but  also  other  available  in-home  services. 

Other  results  show  that  respondents  (both  physicians  and  discharge  planners) 
overwhelmingly  feel  there  is  a  need  for  the  Home  Health  Agency,  but  are  less 
certain  (7  to  6)  that  there  is  a  need  for  increased  or  expanded  services.   The 
most  important  service  offered  by  home  health  is  seen  as  continuity  of  care  and 
the  most  useful  services  to  patients  are  health  teaching  for  independent  living 
and  skilled  nursing  care.   Professional  home  health  nursing  care  was  rated 
"excellent"  by  the  vast  majority  of  respondents. 


Methodology 

Because  physicians,  who  made  up  70%  of  the  surveyed  population,  generally 
do  not  respond  well  to  either  mail  surveys  or  phone  interviews,  we  used  a 
personal  interview  methodology.   The  advantages  of  personally  interviewing 
doctors  and  hospital  discharge  planners  in  their  offices  are  control  of  the 
questionnaire,  insuring  all  questionnaires  are  answered,  hesitancies  are 
probed,  and  the  importance  of  the  research  is  underscored  by  making  a  personal 
visit  to  the  medical  professional  in  his  or  her  office. 

Four  groups  of  medical  professionals  were  interviewed:  (1)  doctors  who  refer 
to  Home  Health  often  and  consistently,  (2)  doctors  who  refer  sometimes,  (3)  doctors 
who  do  not  refer  at  all,  and  (4)  hospital  discharge  planners  at  the  three  local 
hospitals.  Most  referrals  come  from  either  doctors  or  discharge  planners. 
(A  separate  Home  Health  patient  survey  is  currently  being  completed  which  will 
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show  patient  satisfaction  about  their  own  home  health  care.) 
The  questionnaire  we  used  was  designed  to  determine: 

1.  The  Missoula  Home  Health  Agency's  perceived  place  in  the 
medical  care  system. 

2.  How  the  decision  to  refer/not  refer  is  reached. 

3.  Importance  and  usefulness  of  services  to  doctors  and  discharge 
planners,  as  well  as  to  the  patients. 

k.      If  medical  professionals  or  patients  have  had  any  un- 
resolved problems  with  the  Home  Health  agency. 

5.  Quality  of  professional  nursing  care. 

6.  Ways  to  improve  services. 

7.  Strategies  to  inform  both  medical  professionals  and  the 
public  about  home  health  services  available  to  them. 

The  questionnaire  was  designed  with  close  cooperation  from  the  Home  Health  staff. 

(See  Appendix  A  for  questionnaire.) 

Differences  in  referral  frequency  and  sources  of  referrals  meant  that  the 

questionnaire  would  have  to  be  kept  largely  open,  i.e.,  respondents'  answers 

would  be  written  verbatim,  instead  of  using  all  closed  response  categories 

(like  #3,5,8)  where  individual  replies  and  coTmnents  are  often  lost.   (Note: 

open  response  categories  work  only  if  one  or  two  professional  interviewers 

conduct  the  survey  in  the  same  way,  asking  the  same  questions  in  a  duplicate 

manner.   This  survey  was  conducted  by  the  Health  Department's  two  person 

research  staff.) 

Results 

The  results  are  presented  to  you  in  three  parts,  from  respondents  who  refer 
(J)  frequently  (n=7),  (U)   seldom  (n=5),  and  (JJJ)  never  refer  (n=4)  .*  (Note: 
when  we  asked  respondents  in  Category  III   if  they  had  ever  referred  a  patient 
to  Home  Health  care,  three  of  the  four  said  they  had!) 

1.  First,  do  you  feel  there  is  a  need  for  the  H.D.'s  HH  Agency? 

I   II       III       Total 


f. 


Yes 

6 

5 

3 

14 

No 

. 

0 

DK/NR 

> 

_ 

1 

1 

{i 


*Please  note:  Categories  may  not  add  up  because  of  double  interviewing, 
respondent  error  or  other  interviewing  adjustments. 
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1.  Is  there  also  a  need  for  increased  or  expanded  services? 

I        II        III        Total 


Yes 

4 

. 

3 

7 

No 

2 

4 

. 

6 

DK/NR 

_ 

1 

1 

2 

Respondent  Comments;  A  significant  number  of  respondents  who  felt  there  was 
a  need  for  increased  or  expanded  services  also  said  that  there  was  a  need  for 
more  frequent  visits.   Some  respondents  felt  that  more  frequent  visits  could 
be  used  to  check  in  with  patients  to  see  if  they  are  taking  their  medication, 
eating  well,  and  to  provide  some  reassurance  to  home-bound  patients.   One 
doctor  was  not  sure  what  home  health  covers  and  one  felt  that  the  Missoula 
Health  Department's  Agency  duplicated  available  home  health  services  offered 
by  the  Rehabilitation  Center's  Agency.   One  respondent  wanted  more  Hospice-type 
care. 

2.  What  factors  do  you  use  when  deciding  whether  or  not  to  refer  your  patients 
to  HH  care?  (Note:  Responses  are  grouped  Intomost  frequently-mentioned  only.) 


I 

II 

Ill 

Nursing  needs  (  esp. 

Type  nursing  care 

NO  CONSISTENT  RESPONSE 

if  not  sure  patient 

needed. 

Comments  not  correlated 

can  take  care  of  self, 

but  need  some  help  or 
need  checking  on.) 

If  patient  lives  alone 
do  they  have  help?  Are 
they  capable  of  taking 

Aval lable  support 
system. 

Can  patient  come  to 
physician  office 
easi ly? 

Function  of  Home 
Health  is  to  check  on 
patients. 

Carrying  out  doctor 
orders. 

care  of  self? 

Does  patient  1 ive 

If  patient  requires 

alone? 

evaluation  in/of  home. 

If  patient  requires 
home  health  care. 

If  Home  Health  nurse 
can  provide  neeeded 
care. 

2a.  Have  you  ever  referred  a  patient  to  HH? 

Note;   This  question  was  asked  to  confirm  that  Category  JJJ  respondents 
had  indeed  not  referred.   Three  of  the  four  said  that  they  had,  indeed, 
referred  a  patient  to  Home  Health  care.  The  one  physician  who  had  not  said 
that  he  used  the  Rehabilitation  Center  because  it  was  easy  to  initiate  services 
and  he  could  set  up  services  before  the  patient  left  the  hospital.   Results  are 
reported  in  Category  III   for  all  four  doctors. 
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3.  From  your  viewpoint,  what  is  the  first  and  second  most  important  service 
offered  by  HH? 

I  II  III 


m    i 


#1 

#2 

Total 
Group  I 

#1 

#2 

Total 
Group  11 

#1 

#2 

Total 
Group  III 

Total 

a.  help  the  patient's 
family  provide  care. 

1 

1 

2 

0 

2 

2 

1 

1 

2 

b.  provide  less  costly 
care. 

1 

0 

1 

1 

1 

2 

0 

0 

0 

c.  act  as  alternative 
to  nursing  home. 

1 

2 

3 

1 

1 

2 

2 

0 

2 

d.  teach  patient/care- 
taker about  health 
needs. 

0 

0 

0 

1 

2 

3 

1 

0 

1 

e.  shorten  hospital 
stay. 

1 

0 

1 

0 

0 

0 

0 

0 

0 

f.  insure  continuity 
of  care. 

2 

3 

5 

1 

1 

2 

0 

2 

2 

g.  provide  care  more 
appropriate  to 
patient's  needs. 

1 

1 

2 

1 

0 

1 

0 

1 

1 

k 

4»   i 


(Note:  In  case  of  a  tie  where  the  respondent  would  not  choose  one  answer,  both  responses 
are  shown. ) 

Analysis:   Teaching  the  patient/caretaker  about  health  needs  (d)  is  seen  as 

the  least  important  service  to  Group  I,   shortening  hospital  stay  (e)  was  least 

important  service  to  Group  II ,   and  providing  less  costly  (b)  and  shortening 

hospital  stay  (e)  were  least  important  to  Group  III.      Interestingly,  for  those 

who  refer  to  Home  Health  care  a  great  deal,  continuity  of  care  (f)  ranked 

highest,  but  less  so  for  Group  II,   who  generally  felt  that  teaching  the  patient/ 

caretaker  about  health  needs  (d)  was  most  important. 

4.  Do  you  refer  patients  to  other  agencies  which  provide  services  in  the  home, 
like  Meals  on  Wheels,  Homemaker  Services,  RSVP,  etc? 


I 

II 

III 

Total 

Yes 

6 

5 

2 

13 

No 

_ 

_ 

2 

2 

If  yes,  which  services? 

Group  I       -     Generally  refers  to  Meals  on  Wheels,  and  a  variety  of 

other  services  ("Homemakers,"  "Y  Program,"  "Transportation 
Services,"  "Hospice,"  "anything  available,"  and  "social 
workers  do  that,  or  the  Home  Health  nurses." 

Group  II     -     was  more  likely  to  refer  to  Meals  on  Wheels,  RSVP, 

although  they  also  cited  Homemakers  Program,  Homechores, 
and  telephone  reassurance. 
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Group  III  -   is  much  less  likely  to  refer  to  any  service.   The 

Rehabilitation  Center  and  Hospice  were  both  mentioned, 
but  we  found  a  clear  sense  that  doctors  in  this  group 
do  not  have  sufficient  information  about  any  type  of 
of  in-home  services  to  refer  to  them. 


5.  Which  form  of  care  do  you  consider  the  most  useful  to  your  patients  referred 
to  HH  care? 


I 

II 

III 

Total 

a.  personal  care 

(bathing,  grooming,  etc.) 

0 

1 

1 

2 

b.  health  teaching  for 
independent  1 iving 

3 

2 

2 

7 

c.  physical ,  speech  or 
occupational  therapy 

0 

0 

0 

0 

d.  skilled  nursing  care 
(dressing  changes  ...) 

1 

A 

1 

6 

don't  know/no  response 

1 

0 

1 

2 

Analysis:   Group  I  sees  health  teaching  (b)  as  most  useful  and  personal 
care  (a)  and  physical,  speech  or  occupational  therapy  (c)  as  least  useful 
to  their  patients  referred  to  home  health  care.   Group  II  feels  that  skilled 
nursing  care  (d)  is  most  useful,  while  Group  III  was  more  inclined  to  view 
health  teaching  (b)  as  most  useful,  but  by  a  very  small  margin.   Interestingly, 
general  comments  show  that  respondents  would  like  to  see  home  health  provide 
more  personal  care,  but  that  form  of  care  (a)  rated  very  low  on  this  question. 
This  anomaly  could  be  attributed  to  the  practical  "what  is"  nature  of  question 
five  and  the  more  abstract  "what  would  you  like"  nature  of  question  one. 


6-  How  about  patients  you've  referred  to  HH:  Have  thev  discussed  their  HH  care 
with  you? 

I  II        III       Total 

Yes 
No 
No  Response 


6 

5 

1 

12 

0 

0 

2 

2 

0 

0 

1 

1 
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Respondent  Comments ;  We  asked  whether   patients   were  pleased  or 

displeased  with  their  care,  and  received  the  following  comments,  quoted 

verbatim:  A  few  patients  seemed  to  be  reticent  on  the  home  health  nurses. 

Often  the  home  health  nurse  is  more  helpful  to  the  doctor  than 
the  patient. 

Just  wished  patient  could  get  aare  more  often  and  longer. 

Very  pleased. 

Pleased  with  aare. 

Respondents   (discharge  planners)  felt  that  public  health  care  should 
be  free;  patients  felt  in  some  cases  that  home  health  cost  was  a 
problem. 


7.  Have  you  ever  had  any  problem  communicating  your  orders  for  the  patient  to 
the  HH  Agency? 


Yes 
No 
No  Response 


II 


III 


Total 


1 

2 

0 

3 

5 

3 

3 

11 

0 

0 

1 

1 

((> 


Respondent  Comments ;  Group  I  who  refers  to  home  health  most  often  also  had 
relatively  few  problems.   Interestingly,  Group  II  reported  the  proportionately 
higtest  number  of  problems,  which  strongly  indicates  that  intermittence  in  working 
with  home  health  leads  to  misunderstandings.   Several  respondents  mentioned 
problems  of  getting  to  talk  to  nurses,  or  problems  unless  they  talked  to  a 
"nurse  who  is  intelligent  to  take  a  message."  One  respondent  who  had  a 
problem  with  the  Home  Health  Agency  said  that  a  referral  was  not  passed  from 
secretary  to  nurse  and  in  another  case  the  nurse  tried  "only  once"  to  call  the 
doctor  about  a  patient  who  needed  home  health  care.   Another  respondent  mentioned 
phone  disconnections  and  resenting  mailing  in  the  pink  sheets  to  the  Department. 
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8.  How  would  you  rate  the  level  of  professional  nursing  care  given  by  HH  nurses? 

I  II  III  Total 


Excel  lent 

6 

3 

2 

11 

Good 

- 

2 

1 

3 

Fair 

- 

- 

- 

Poor 

- 

- 

- 

-- 

Unacceptable 

- 

- 

- 

-- 

Don ' t  Know 

- 

- 

1 

1 

Analysis ;  There  is  no  doubt  (or  surprise)  that  those  who  use  home  health 
a  great  deal  also  have  the  most  faith  in  the  quality  of  professional  nursing 
care.   Groups  II  and  III  were  more  likely  to  see  the  quality  of  professional  nursing 
care  as  slightly  lower  than  perceived  by  Group  I. 

9.  What  suggestions  do  you  have  to  improve  HH  services? 


Group  I  Comments  (verbatim) : 


Make  me  more  awcace  of  alt  available  services 
for  patients. 

Go  into  the  home  more  often  and  stay  longer. 

I'd  like  an  evaluation  from  the  home  health 
nurse  of  what 's  neaessain/  for  the  patient 
and  from  a  professional  'e  point  of  view. 

Need  personal  oare  services  to  enable 
patients  to  stay  home. 

More  frequent  visits^   especially  for  health 
maintenance  and  for  what  could  been  seen  as 
no  social  justification — like  to  insure  that 
patients  are  eating  properly  and  for  reassurance. 
Also  J   there  is  a  need  for  daily  visits,   or 
perhaps  volunteers  could  fulfill  that  role  of 
seeing  a  patient  daily  and  just  checking  on  them. 

The  billing  system  is  hard  for  a  patient  to 
understand.     It  would  improve  services  to 
provide  oare  more  than  once  per  day.     Need 
more  home  health  staff. 
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Group  II  Comments  (verbatim) 


Group  III  Comments  (verbatim) 


More  personal  health  aare  from  non-nurses. 
Arahiteatural  advice  and  help  to  facilitate 
movement^   bathroom  use^   eta. 

Better  oommuniaation  between  the  doctor  and 
home  health  nurse. 

Some  people  are  unaware  Home  Health  exists. 

More  staff. 

Avoid  politics  and  concentrate  on  health  care. 

Lot  of  patients  require  more  personal  care — 
bathing^    transfers^   etc.    to  maintain  independent 
living. 


10.  How  should  HH  inform  both  medical  professionals  and  the  public  about  HH  services 
available  to  them? 


Group  I  Comments    (verbatim) 


On  a  one-to-one  basis  with  doctors y  volunteer 
to  do  in-services  to  hospitals  so  hospital 
staffs  can  mention  care  to  their  patient. 
More  PSA's.      Brochure  good. 

Personal  care  aides  needed  to  help  with  things 
like  getting  breakfast  and  getting  dressed. 
News  media  doing  a  good  job.     Yearly  send  a 
brochure  or  make  a  personal  visit  to  doctors. 
They  need  to  be  reminded. 

The  average  doctor  turns  to  the  hospital  social 
worker,   so  maintain  contact  with  them.     Also 
visit  appropriate  doctors.     Probably  won't  get 
new  patients  from  media  spots  to  general  public. 
Don't  advertise  unless  you  can  get  it  for  free. 

Brochure  is  good,  but  must  keep  handing  them  out. 
Have  done  a  good  job  this  past  year  (with  PSA's) ^ 
now  you  must  keep  it  up.     Reach  new  doctors. 

Make  all  doctors  aware  of  home  health  by  going 
to  medical  society  or  hospital  meetings.     Be 
sure  staffs  of  rest  homes.   Eagles  Manor,   etc. 
are  aware  of  services. 
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Should  be  a  speaker  from  the  Health  Department 
at  hospital  aonferenaes .  Patients  ask  me  about 
home  health;  make  them  (pts)  more  aixire  of  the 
services.  Make  hospital  nurses  more  aware 
because  they  often  make  suggestions  to  doctors ^ 
but  be  careful  you  don't  ignore  the  doctors  in 
the  information  process. 

Group  II  Connnents  (verbatim) :  Article  in  newspaper  about  Home  Health 


Presentation  to  physicians  at  medical  meetings 
(i.e.y   Western  Montana  Medical  Society). 
Communication  with  hospitalized  patients. 

Concentrate  on  hospital  social  services  and 
direct  public  education  programs.     Use  the 
media.     Make  reports  to  medical  staffs  or 
doctor's  groups  J  Meals  on  Wheels  clients ^ 
homemakersj   hospital  nursing  staffs  and 
rehabilitation  personnel. 

A  list  every  four  to  six  months  of  available 
services;  notices  and  ads  in  the  papers. 

Group  III  Comments  (verbatim) :  Send  out  flyers  on  a  quarterly  basis  to  doctors 

and  hospitals.     Use  ads  on  radio  and  TV  so 
patients  can  ask  their  doctors  about  Home  Health. 
Update  home  health  information.     What  I  don 't 
know  about  J   I  don't  use. 

Send  a  monthly  resume  of  how  the  patient  is 
doing  to  their  doctor.     For  the  public ^  use 
radio  and  newspaper.     Other  agencies  and 
organizations  will  be  more  helpful  than  doctors 
to  spread  the  word. 

Bulletin  to  explain  what  is  aoailable  and  how 
to  get  in  touch  with  the  Home  Health  Agency. 
Newspaper  articles. 

TV  spots  to  the  public.      Use  the  Friday  morning 
medical  meetings  at  Saint  Patrick  Hospital. 
Presentations  to  Senior  Citizens  Center. 


Conclusions  and  Recommendations 

First,  this  survey  was  an  informal  effort  and,  as  such,  does  not  closely  follow 
established  research  design.   The  information  we  gathered  is  presented  to  you  in 
suiranary  form  and  the  translation  from  quick  interview  notes  to  more  complete  and 
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intelligible  phrases  is  subjective. 

Second,  the  strongest  recommendation  I  have  to  make  on  the  basis  of  these 
results  is  that  a  strong  public  relations  and  marketing  campaign  be  instituted 
to  close  the  wide  gap  between  available  home  health  services  and  services  used 
by  medical  professionals.   The  concensus  among  respondents  was  that  a  strong 
professional  presentation  to  medical  and  nursing  groups  would  be  most  effective. 
(Perhaps  a  complete  panel  with  representatives  from  each  of  in-home  care  agencies 
to  give  medical  and  social  work  professionals  a  thorough,  over-all  view  of 
available  services?)  The  home  health  brochure,  public  service  announcements  and 
newspaper  and  other  media  spots  are  important,  but  must  be  "maintained,"  i.e., 
continued  regularily,  updated  and  kept  current  and  in  front  of  the  public. 

Third,  in  general,  the  survey  shows  a  very  strong  regard  for  the  level  of 
professional  nursing  care,  and  relatively  few  communication  problems  between 
the  agency  and  medical  professionals.   Somewhat  surprising,  however,  are  the 
differences  of  perception  of  the  role  of  home  health  care  (question  three)  and 
the  most  useful  home  health  service.   This  result  may  not  be  so  surprising, 
after  all,  when  looking  at  the  general  misunderstanding  of  what  home  health  is, 
how  it  operates  and  what  population  it  is  designed  to  serve  (especially  when 
respondents  call  for  more  personal  care — "getting  dressed  and  getting  breakfast," 
"checking  on  patients'  diets  and  insuring  patients  make  their  appointments."). 

It  was  our  pleasure  to  conduct  this  survey  for  you.   Be  sure  to  contact  me 
to  answer  any  questions  that  you  have,  or  to  explain  more  fully  any  respondent 
comments.   (Some,  I'll  warn  you,  aren't  meant  to  be  clear;  they're  meant  to 
show  that  respondents  do  not  know  what  home  health  services  means!) 


JSH/j 

qstr.  attached 


r 


(  ♦ 
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A  -  refers  consistently 
B  -  refers,  but  seldom 
C  -  do  not  refer 


^COPE. 
i  -  physician 

2  -  discharge  planner 


lnterviewer_ 
Code 


HOME  HEALTH  REFERRAL  SURVEY 

The  purpose  of  this  survey  is  to  find  out  which  HH  services  most 
benefit  you,   and  also  to  he  better  advised  about  what  you, 
professionally ^  like  and  don't  like  about  HH   core. 

First,  do  you  feel  there  is  a  need  for  the  H.D.'s  HH  Agency? 

yes •^  Is  there  also  a  need  for  increased  or  expanded  services?  yes 

no 


no -)  Why  do  you  say  that?_ 


A/B   2.  What  factors  do  you  use  when  deciding  whether  or  not  to  refer  your  patients 
to  HH  care? 


>) 


Have  you  ever  referred  a  patient  to  HH? 

_yes ^    (go  to  #2,  A/B) 

no- -)  Why  is  that? 


From  your  viewpoint,  what  is  the  first  and  second  most  important  service 
offered  by  HH?     (respondent  card) 


help  the  patient's  family  provide  care 

provide  less  costly  care 

act  as  alternative  to  nursing  home 

teach  patient/caretaker  about  health  needs 

shorten  hospital  stay 

insure  continuity  of  care 

provide  care  more  appropriate  to  patient's  needs 


Do  you  refer  patients  to  other  agencies  which  provide  services  in  the  home, 
like  Meals  on  Wheels,  Homemaker  Services,  RSVP,  etc? 


yes- 


■^  Which  services?_ 


->  Why  is  that?_ 
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/\/B   5.  Which  form  of  care  do  you  consider  the  most  useful  to  your  patients  referred 
to  HH  care?   (reepondent  ocird) 

'V     a*  personal  care  (bathing,  grooming,  etc.) 

b.  health  teaching  for  independent  living  (teaching  diabetics  to  give  their 
own  insulin  injections) 

c.  physical,  speech  or  occupational  therapy 

d.  skilled  nursing  care  (dressing  changes,  catheter  care) 

A/B   6.  How  about  patients  you've  referred  to  HH:  Have  they  discussed  their  HH  care 
with  you? 

__  yes )  Were  they  pleased  or  displeased  with  their  care? 

no 

A/B   7.  Have  you  ever  had  any  problem  communicating  your  orders  for  the  patient  to 
the  HH  agency? 

yes )  Type  of  problems? 


fl 


no  8 


/VB   8-  How  would  you  rate  the  level  of  professional  nursing  care  given  by  HH  nurses? 
excellent   good   ^fair   ^poor   unacceptable 

A/B   9.  What  suggestions  do  you  have  to  improve  HH  services? 


10.  How  should  HH  inform  both  medical  professionals  and  the  public  about  HH 
services  available  to  them? 


THANK  YOU! 
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SECTION  ^ 
REFERRALS  FOR  SERVICE  -  PROTOCOL  AND  REFERRAL  RECORD 


Results  -  A.  Protocol:  The  Missoula  Health  Department  did  not  have  a  written 
guide  describing  acceptable  and  non-acceptable  referrals  until  the  Referral 
Protocol  (page  k.2)   was  developed.   The  protocol,  intended  to  quantify  what 
types  of  patients  and  under  what  conditions  referrals  for  service  are  to  be 
accepted,  helps  insure  agency  consistency.  The  Department  was  also  concerned  with  a 
a  low  acceptance  to  referral   ratio.  The  protocol  is  currently  being  tested 
in  Missoula  until  approximately  October,  198I  to  determine  if  it  is  accurate, 
workable,  and  complete.   Analyzing  referral  forms  will  show  whether  or  not  the 
protocol  is  being  used  effectively. 

B.  Referral  Record:  The  Record  (page  4.5)  also  insures  consistency  and  accuracy 
in  telephone  referrals  from  both  health  professionals  and  the  public.   A  referral 
log  (cited  in  the  original  evaluation  plan,  Section  6)  would  also  be  effective, 
but  the  advantage  of  a  two-part  Referral  Record  is  that  one  copy  can  be  kept 
for  a  referral  file  and  one  copy  can  be  routed  to  the  nurse  who  is  assigned  to 
handle  the  case.   The  Record  has  been  proven  to  be  very  effective  when  it  is  filled 
out  completely. 

Discussion  -  The  purpose  of  both  the  Protocol  and  Referral  Record  is  to  insure 
program  consistency.   Home  Health  administrators  felt  that  there  was  too  much 
time  wasted  with  Inappropriate  referrals  {kS%   of  referrals  were  inappropriate 
and  those  patients  were  not  added  to  the  caseload),  so  both  the  Protocol  and 
Referral  Record  are  seen  as  a  way  to  correct  this  problem. 

Methodology  -  A.  Protocol:  The  Protocol  should  be  reviewed  by  nursing  staff  and 
clerical  personnel  in  a  training  session  or  staff  meeting.   After  it  has  been 
used  for  six  months  (or  quarterly),  it  should  be  evaluated  for  effectiveness. 
One  way  to  evaluate  the  Protocol  is  to  see  if  the  percentage  of  cases  accepted 
to  total  referrals  has  improved. 

B.  Referral  Record:  To  be  serviceable,  a  record  must  be  completely  filled  out 
for  each  referral.   It  can  be  designed  so  that  a  home  health  nurse  or  supervisor 
receives  one  copy,  while  the  other  copy  is  filed  for  a  permanent  record.   Referral 
Records  whould  be  reviewed  at  set  time  periods  to  insure  they  are  being  filled 
out  completely  and  to  gather  home  health  statistics. 


Section  4,  Page  1 
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HOME  HEALTH  REFERRAL  PROTOCOL 


This  referral  protocol  is  a  guide  to  all  Nursing  Division  staff  to  insure 
appropriateness  of  referrals  to  the  Home  Health  Agency  and  to  summarize 
alternative  community  support. 

Referrals  Made  by  Physician  or  Office  Nurse;   If  specific  orders  or  medications 
are  included,  the  referral  must  be  completed  by  a  registered  home  health  nurse. 
If  an  RN  is  not  available,  take  the  general  information  (name  of  patient, 
doctor,  telephone  number)  and  tell  the  person  making  the  referral  that  a  home 
health  nurse  will  return  the  call  as  soon  as  possible  for  further  information. 
Refer  to  daily  sign-out  sheet  to  locate  an  RN  is  situation  needs  immediate 
attention. 

Referrals  Made  by  Other  Source:   If  referral  is  made  by  a  registered  nurse, 
hospital  discharge  planner,  social  worker,  family  member,  social  service 
agency,  or  other  person,  and  the  referral  does  not  include  doctor's  orders 
or  medication,  refer  to  the  following  protocol. 


Missoula  City-County  Health  Department 
Nursing   Division 
HOME   HEALTH   REFERRAL   RECORD 


Pt.  Name 
Address 

Spouse 

Phone 

Age 

D.O.B. 

Referred  by 
Pt's  Doctor 

Phone  

Diagnosis                                        1 

Hospital 

from 

"       1 

ORDERS/NEEDS 


"HOW  DID  YOU  FIP.SZ  LEARN  ABOUT  HOME  HEALTH  CARE?  ' 


Health  'ns.  Claim  # 
Date  Ca-e  Started 
Pt.  Status 


neu  admission 
readmit  same  dx 
readmit  different  dx 


^.z. 


(: 
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REFERRAL  PROTOCOL 


ACCEPTED  REFERRALS: 

I.   Colostomy-Ileostomy 

A,  Ostomy  dressing  changes 

B.  Instruction  to  client  and/or  family 

II.   Cancer  Care 

A.  Post-surgical  skilled  nursing 

B.  Terminal  care 

C.  Dressing  changes 

D.  Health  teaching 

III.   Catheter  care — Irrigations 

A,  Indwelling  foley 

B,  Catheterization  for  culture 

C,  Irrigations 

D,  Instructions  for  cath  care  -  irrigations  to  client  and/or  family 

E,  Teaching  self  catheterization 

IV,  Dressing  Changes  and  Wound  Care 

A.  Decubiti,  ulcers,  incisional  wounds 

B,  Teaching  client  or  family  wound  care 

C.  Wound  irrigations  -  application  of  medications 

D,  Suture  removal 

V.   Exercises 

A.  Passive  ROM 

B.  Teaching  body  mechanics  for  transfer  of  client 

VI,   Medications  -  Injections 

A.  Review  meds  with  client  or  family  and  assist  in  setting  up  daily  regime 

B.  Instructions  to  give  insulin,  injections  or  teach  family  members 

C.  Weekly  filling  of  Insulitx  syringes 

D.  Short  term  daily  insulin  injections 

E.  B12  injections 

F.  Other  parenteral  meds  per  doctors  order 

VII.   Teaching 

A.  Diabetic  care 

B.  Special  diets 

C.  Ostomy  care 

D.  Nasogastric  home  care 

E.  Trach  care 

F.  COPD  s-elf  care 

G.  Self  administered  injection 

H,   Care  of  terminally  ill  or  bedridden  teaching  to  promote  optimum  comfort 

A. 3 
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VIII.   Venipuncture 

A.  Blood  drawing  for  lab  analysis 

IX.   Vital  Signs 

A.  Orthostatic  hypotension 

B.  Hypertension 

C.  C.V.A. 

D.  C.H.F. 

E.  Medication  regulation 

F.  Renal  impairment 

X.   Personal  care 

A.  Most  generally  accepted 

NOT  ACCEPTED 


-  more  than  one  visit  daily 

-  24-hour  care 

-  loan  of  equipment  to  client  not  on  caseload  or  to  furnish  supplies  only 

-  daily  assistance  for  personal  care 

-  daily  visits  to  insure  client  takes  meds  as  ordered 

-  allergy  desensitization 

-  home  chores 

-  no  transportation  available 

-  emergency  services  of  patients  not  on  caseload. 


SUPPORT  AGENCIES 


1.  Home  Attendants:   call  discharge  planners  -  Peg  Kurtz/Maureen  O'Malley 

St.  Patrick  Hosptial  543-7271 

-  Delia  Swartz/Gloria  Horesji 
Community  Hospital  728-4100 

-  Diane  Peterson 

Missoula  General  Hospital  542-2191 

2.  Home  Assist  Program,  YWCA  -  543-6691 

3.  Home  Chores  and  Mini  Bus,  Senior  Citizen  Center  -  549-8970 

4.  Meals,  Missoula  County  Nutrition  Project,  Nancy  Adams  549-6621 

5.  Hospice  -  549-7757 

6.  Missoula  Cancer  Society  and  American  Cancer  Society,  Betty  Heimberger  549-8804 

7.  Homemaker,  Dept.  of  Public  Welfare   721-5700,  ex.  421. 
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TO 
FROM 
DATE 

RE 


MISSOULA  CITY- COUNTY 
HEALTH  DEPARTMENT 

301  West  AldRr  •  Missoula,  Montana  59801  ■  Ph.(406)721-5700 

Jean  Pinsoneault,  Home  Health  Supervisor 

Susan  Plath,  Research^f jL^^ 

November  30,  198l 

Review  of  Home  Health  Referral  Protocol 

The  Referral  Protocol  was  developed  to  help  reduce  the  number  of  referrals  that 
were  not  admitted  to  the  Home  Health  caseload.   A  record  audit  conducted  from 
May-October,  198l ,  revealed  that  the  percentage  of  cases  accepted  to  total  referrals 
had  increased  slightly  from  last  year  {^3%   accepted  in  1980,  51^  accepted  in  198l). 

BackgfLOund  and  He.thodologtj 

The  purpose  of  the  Home  Health  Referral  Protocol  (protocol)  is  to  insure  program 
consistency  .  Home  Health  administrators  felt  there  was  too  much  time  wasted  with 
referrals  that  were  not  admitted  to  the  caseload.   Last  year  (January  -  December 
1980),  kSZ   of  the  referrals  were  on  patients  who  were  not  added  to  the  caseload, 
so  the  Protocol  was  seen  as  a  way  to  correct  this  problem. 

The  Protocol  was  evaluated  after  six  months  for  its  effectiveness.   One  way  to 
evaluate  the  Protocol  is  to  see  if  the  percentage  of  cases  accepted  to  total 
referrals  has  improved.   This  was  done  by  counting  the  number  of  referred  cases, 
the  number  of  those  cases  accepted  and  the  number  rejected  and  then  comparing  those 
results  with  the  same  six-month  period  from  last  year. 

A  total  of  ni  referrals  were  made  to  the  Home  Health  Unit  between  May  and  October, 
1981.   Of  those  111  referrals,  57  cases  (SVl)    were  accepted  and  S^i    (A9^)  were  not 
accepted  to  the  caseload.   Ninety-tvjo  (9?-)  total  referrals  were  made  from  May  - 
October,  I98O.   Of  those  92  referrals,  kk   or  ^48'^  were  accepted  and  '♦8  or  52%  were 
unaccepted. 

An  analysis  of  referrals  that  were  not  accepted  to  the  caseload  revealed  four 
distinct  c.ileqories: 

A  -  Referral  for  services  Home  Health  does  not  provide  (i.e.  2^-hour  care, 
home-maker  services,  daily  care,  medication  compliance). 

B  -  Referral,  under  normal  circumstances,  would  be  accepted  to  the  caseload 
(i.e.  patient  re-admitted  to  hospi  ta  1 /nurs  ing  home/etc,  one-time  visit, 
instructing  family  member  on  patient  care,  patient  expired). 

C  -  Records  are  unclear  as  to  action  taken. 

D  -  Patient  or  family  member  canceled  home  health  services,  although  the  services 
may  be  covered  under  home  health. 
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The  results  from  the  May-October  periods  are  listed  below: 

Category 1_980 1981 

A.   Referral  for  service  home  health 

does  not  provide.  21.01^        18.5^ 


B.   Referral,  under  normal  circumstances, 
would  be  accepted  to  home  health  case- 


load. 

35.5^0 

30.0? 

C.   Records  unclear  as  to  action  taken. 

8.0°^ 

^^.S% 

D.   Patient  or  family  member  canceled 
home  health  services. 

35.5'^ 

37.0? 

TOTAL 

100.0?, 

100.0? 

Type  of  Visit  Made 

1980 

1981 

Home  Visit 

35?. 

1^6% 

Telephone  Cal 1 

•   35? 

1U% 

No  indication  on  referral  record 

29? 

26? 

Other 

-- 

k% 

TOTAL 

100? 

100? 

These  statistics  indicate: 

1.  There  are  a  large  number  of  referrals  tal<en  for  services  Home  Health 
does  not  provide.   Is  the  Protocol  followed?  Are  enough  questions  asked 
so  we  know  exactly  what  services  are  needed? 

if  requests  are  made  for  services  Home  Health  does  not  provide,  immediate 
public  education  will  help  that  person  better  understand  the  Home  Health 
Program  and  its  services. 

2.  Referral  records,  unclear  in  the  action  taken  on  a  case,  have  increased 
from  8?  in  I98O  (May-October)  to  \k\%    in  I98I  (May-October).   This  6^? 
increase  is  significant  and  worth  close  review.   Does  the  Referral  Record 
provide  enough  space  for  the  Home  Health  Unit  to  make  comments?  Why  has 
the  number  of  unclear  records  increased? 
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3.   There  are   a  large  number  of  canceled  referrals,  although  the  service  may 

be  covered  under  home  health.   A  closer  analysis  of  who  is  making  refer ra's 
may  help  explain  why  so  many  patients  or  family  members  cancel  home  health 
services. 

if  the  referral  source  is  predominently  medical  professionals,  it  may 
indicate  a  communication  breakdown  between  professional  and  patient  or 
family  members.   Are  professionals  making  referrals  without  discussing  it 
with  the  involved  parties?   Do  the  parties  fully  understand  the  referral 
and  what  home  health  will  provide?   Increased  education  may  help  solve 
this  problem. 

If  the  referral  source  is  a  concerned  friend  or  neighbor,  the  likelihood 
that  this  person  has  talked  to  the  involved  person  is  small.   Although 
there  is  not  much  we  can  do  about  improving  this,  we  could  use  this  as 
an  opportunity  to  educate  the  friend  or  neighbor  on  home  health  services. 

k.      A  lot  of  time  is  spent  on  home  visits  to  patients  that  are  never  added  to 
the  caseload.   Possibly  obtaining  more  information  over  the  phone  would 
decrease  the  time  and  money  spent  on  these  referrals. 

ConctiU>ian  and  Re.comm(;ndation.i 

The  number  of  home  visits  made  on  referrals  that  are  not  added  to  the  caseload  is 
costing  the  Home  Health  Unit  time  and  money  -  time  and  money  that  could  be  used  for 
those  needing  home  health  services.   Decreasing  the  number  of  referrals  that  (I)  are 
made  for  services  home  health  does  not  provide  and  (2)  are  canceled  by  patient  or 
family  members,  would  help  streamline  activities. 

I  recommend: 

1.  The  Home  Health  Unit  review  the  Referral  Protocol  and  talk  about  "gray" 
areas  so  all  involved  personnel  handle  referrals  similarly,  thus  providing 
consi  stency . 

2.  A  record  audit  to  find  the  referral  sources  for  those  patients  or  family 
members  who  do  not  accept  home  health  services,  even  though  they  may 
qualify.   Once  the  sources  are  known,  target  education  efforts  toward  that 
group  or  groups . 

3.  Discussing  how  to  decrease  the  number  of  records  that  are  unclear  concerning 
the  action  taken  on  a  case. 

k.      Continuing  to  educate  the  public,  over  the  phone  if  necessary,  and 
professionals  on  home  health  services. 

The  2%    increase  in  referrals  added  to  the  caseload  from  I98O  to  I98I  is  not  a 
significant  percentage  to  draw  conclusions  concerning  the  Referral  Protocol.   I 
recommend  another  Protocol  review  in  six  n)onths.   I  will  conduct  this  review  in 
May,  unless  I  hear  otherwise  from  you. 

It  was  a  pleasure  working  on  this  report  for  you.   If  you  have  any  questions  and/or 
would  like  to  meet  to  discuss  these  results,  please  let  me  know. 
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MISSOULA  CITY- COUNTY 
HEALTH  DEPARTMENT 

301  West  Alder  •  Missoula,  Montana  59802  •  Ph.  (406)  721-5700 


TO:  Jean  Pinsoneault,  Home  Health  Supervisor 

FROM:  Susan  Plath,  Research  and  Evaluation 

DATE:  June  16,  1982 

RE:  Review  of  Home  Health  Referral  Protocol,  Final  Report 

SUMMARY 


The  Home  Health  Referral  Protocol  was  developed  to  help  increase  the  number  of 
accepted  referrals  to  the  home  health  caseload  through  consistency  from  referral 
to  referral.   A  record  review  from  May  1980  -  April  1981  and  May  1981  -  April  1982, 
should  have  revealed  the  effectiveness  of  the  Protocol.   This  did  not  occur 
because  of  a  staff  turnover  in  the  middle  of  the  second  year.   The  new  staff 
person  was  not  trained  on  the  Protocol.   This  person  is  now  aware  of  the  Protocol 
and  understands  its  use.   A  six-month  record  study  (June  -  December)  of  the 
Protocol  would  indicate  its  usefulness. 

BACKGROUND  AND  METHODOLOGY 


The  purpose  of  the  Home  Health  Referral  Protocol  (Protocol)  is  to  insure  program 
consistency.   Home  Health  Administrators  felt  too  much  time  was  spent  on  cases 
that  did  not  meet  home  health  service  guidelines. 

The  Home  Health  division  began  using  the  Protocol  in  May  1981.   To  evaluate  the 
effectiveness  of  the  Protocol,  comparisons  of  the  percentage  of  cases  accepted 
to  total  referrals  was  calculated.   This  was  done  by  counting  the  total  number  of 
referred  cases  for  a  specific  time  period  and  the  total  number  of  those  cases 
accepted  to  the  caseload.   The  results  were  then  compared  to  the  previous 
year's  results,  for  the  same  time  period.   If  the  percentage  improved,  the  Protocol 
could  be  responsible  for  the  increased  efficiency;  if  the  percentage  decreased, 
the  Protocol  may  need  clarification. 

RESULTS 


A  six-month  record  review  from  May-October  1980  and  1981,  revealed  a  slight 
increase  in  1981  in  the  number  of  accepted  referrals  to  caseload.   The  six 
months  in  1980  indicated  49%  of  the  total  referrals  were  added  to  the  caseload 
compared  to  51%  of  the  1981  referrals.   This  increase  was  too  small  to  make  any 
statement  regarding  Referral  Protocol  effectiveness.   It  was  recommended  that 
another  record  review  take  place  for  the  six  months,  November  through  April, 
1980-81  and  1981-82. 

This  report  presents  the  statistics  in  aggregate  (May-April,  1980-81;  1981-82) 
and  segregate  (May-October,  November-April  1980-81;  1981-82)  form.   The  results 
can  vary  depending  on  the  method  used. 

A  total  of  206  records  were  reviewed  during  the  1981-82  evaluation.   Of  those  206 
referrals,  112  cases  (54%)  were  accepted  to  the  caseload.   The  12-month  period 
in  1980-81,  revealed  a  total  of  193  cases.   Of  those,  107  or  55%  were  accepted 
to  the  caseload.   When  looking  at  the  six-month  studies,  the  following  results 
show  an  interesting  trade  off. 
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SEGREGATE  DATA 


AGGREGATE  DATA 


Time 
Period 

May-Get 
1980 

May-Oct 
1981 

Nov-Apr 
1980/81 

Nov-Apr 
1980/81 

Annual 
80/81 

Annual 
81/82 

Accepted 
Referrals 

49% 

51% 

61% 

58% 

55% 

54% 

One  major  factor  influencing  these  results  involves  personnel  turnover.   In 
September,  a  new  secretary  began  working  for  the  Home  Health  division.   She  did 
not  know  about  the  Referral  Protocol  until  the  study  was  finished.   This  makes 
it  impossible  to  evaluate  the  Protocol  effectiveness.   Although  the  results 
will  not  signify  effectiveness,  they   are  presented  for  your  information. 

Closer  analysis  of  those  cases  that  were  not  accepted  to  the  caseload,  revealed 
four  distinct  categories: 

A  -  Referral  is  for  services  Home  Health  does  not  provide  (i.e.  24- 
hour  care,  home-maker  services,  daily  care,  medication  compliance). 

B  -  Referral,  under  normal  circumstances  would  be  accepted  to  caseload 
(i.e.  patient  re-admitted  to  hospital/nursing  home,  one-time  visit  - 
education/instructing  family  member  on  patient  care,  patient  expired). 

C  -  Records  are  unclear  as  to  action  taken,  although  an  ID  card  was 
completed  and  contains  the  necessary  information. 

D  -  Patient  or  family  member  canceled  home  health  services,  although 
service  may  be  covered  under  home  health. 

SEGREGATE  DATA 


May-Oct 
Category                 1980 

May-Oct 
1981 

Nov-Apr 
1980-81 

Nov-Apr 
1981-82 

A. 

Referral  for  service  home  health  does 

not  provide 21%  . 

.  .19%  . 

.  .41%.  . 

.  29% 

B. 

Referral,  under  normal  circumstances 

would  be  accepted  to  caseload 36%  . 

.  .30%  . 

.  .31%.  . 

.  47% 

C. 

Records  unclear  as  to  action  taken, 

although  ID  card  completed 8%  . 

.  .15%  . 

.  .  4%.  . 

.   4% 

D. 

Patient  or  family  member  canceled  home 
health  service 36%  . 

.  .37%  . 

.  .24%.  . 

.  20% 

Percentages  may  not  add  to  100%  due  to  rounding. 
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AGGREGATE  DATA 

Annual      Annual 
Category 1980-81     1981-82 


A.  Referral  for  service  home  health  does 

not  provide 31%  ....  23% 

B.  Referral,  under  normal  circumstances 

would  be  accepted  to  caseload 34%  ....  38% 

C.  Records  unclear  as  to  action  taken, 

although  ID  card  completed 6%  .  .  .  .  10% 

D.  Patient  or  family  member  canceled  home 

health  service 29%  ....  29% 

Percentages  may  not  add  to  100%  due  to  rounding. 

As  you  can  see,  looking  at  the  information  on  a  segregate  basis  reveals  results 
one  way,  the  aggregate  quite  another.   The  aggregate  data  provides  a  picture  of 
what  is  happening  throughout  the  year  and  stabilizes  fluctuations  in  segregate 
data  (example:  C,  above.  Segregate  data  for  May-Oct  1981=15%;  Nov-Apr  1981/82=4%; 
Aggregate  data  stabilizes  this  at  10%  for  the  year) . 

The  segregate  data  is  helpful,  if  collected  on  a  six-month  basis.   It  can  help 
standardize  procedures  and  policy  implementation,  pinpoint  problem  areas,  and 
provide  valuable  management  data. 

These  statistics  indicate  a  significant  number  of  referrals  on  patients  who 
canceled  the  service.   Many  of  these  patients  received  a  telephone  call  or  home 
visit.   Learning  who  is  referring  these  patients  may  prove  beneficial. 

If  the  referral  source  is  predominently  medical  professionals,  it  may  indicate 
a  communication  breakdown  between  professional  and  patient  or  family  members. 
Are  professionals  making  referrals  without  discussing  it  with  the  involved 
parties?   Do  the  parties  fully  understand  the  referral  and  what  home  health 
will  provide?   Increased  education  may  help  alleviate  this  problem. 

If  the  referral  source  is  a  concerned  friend  or  neighbor,  the  likelihood  that 
this  person  has  talked  to  the  involved  person  is  slim.   Although  there  is  not 
much  we  can  do  about  improving  this,  we  could  use  this  as  an  opportunity  to 
educate  the  caller  on  home  health  services. 

The  percentage  of  "A"  category  referrals  has  decreased  from  1980  to  1982  figures 
(1980-81=31%;  1981-82=23%).   Possibly,  the  education  efforts  could  explain  this 
decrease.   Continued  education  efforts  should  continue  to  decrease  the  "A" 
category  referrals. 

The  type  of  visit  made  on  cases  that  were  not  accepted  to  caseload  helps  admini- 
strators learn  of  time  and  cost  expenditures.   If  all  home  health  staff  time  is 
spent  conducting  home  visits,  then  clarification  of  the  Referral  Protocol  may 
help  by  screening  those  cases  the  Home  Health  Agency  can  not  accept.   The 
following  Table  indicates  the  type  of  contact  made  with  potential  clients. 
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SEGREGATE  DATA 


AGGREGATE  DATA 


Type  of  Visit  Made 

May-Oct 
1980 

May-Oct 
1981 

Nov- Apr 
1980/81 

Nov-Apr 
1981/82 

Annual 
1980/81 

Annual 
1981/82 

Home  Visit 

35% 

46% 

40% 

35% 

37% 

41% 

Telephone  Call 

35% 

24% 

44% 

38% 

39% 

32% 

No  indication  on 
referral  record* 

29% 

26% 

7% 

15% 

19% 

21% 

Other** 

0% 

4% 

9% 

12% 

4% 

5% 

*Indication  of  type  of  visit  on  ID  card. 
**Examples:  readmit  to  hospital  before  visit  made;  expired  before  visit,  etc, 
Percentages  may  not  add  to  100%  due  to  rounding. 


Home  visits  were  made  to  the  "B"  category  patients  in  the  majority  of  cases.   The 
one  exception  was  for  the  May-October  1981  time  period,  where  the  majority  of 
visits  were  made  to  clients  who  requested  services  the  Agency  did  not  cover. 

CONCLUSIONS  AND  RECOMMENDATIONS 

Training  new  staff  in  all  areas  of  Home  Health,  including  protocols,  is  critical 
to  an  efficient  office.   A  staff  turnover  occured  during  this  study.   The  new 
person  did  not  use  the  Referral  Protocol  in  streamlining  cases.  A  record  review 
in  six  months  will  provide  accurate  data  on  the  Protocol's  effectiveness. 

Recommendations  include: 


1.  A  record  review  in  six  months  to  evaluate  the  Protocol  effectiveness. 

2.  The  Home  Health  Unit  (including  secretarial  staff)  review  the  Referral 
Protocol  at  least  once  a  year.   It  is  necessary  that  staff  interpret  the 
Protocol  in  a  similar  manner.   This  will  standardize  the  Unit. 

3.  Provide  orientation  sessions  for  staff,  which  includes  reading  and  discussing 
the  Home  Health  Evaluation  Model  and  those  instruments  utilized. 

4.  A  record  review  to  find  the  referral  sources  on  patients  who  cancel  home 
health  services.   This  could  be  done  at  the  same  time  as  the  six-month 
Protocol  review. 

5.  Continue  education  efforts  with  the  health  care  community. 

6.  Continue  collecting  data  on  a  regular  basis.   Areas  of  service  do  change  and 
it  is  necessary  to  update  all  protocols  and  instruments,  as  necessary. 
Collecting  data  helps  point  out  problem  areas  that  are  otherwise  unnoticed. 
For  example,  several  suggestions  were  offered  for  improving  the  Referral 
Record  to  meet  changing  needs  in  the  Unit.   The  revised  copy  is  attached. 


It  was  a  pleasure  working  on  this  report  for  you. 
please  do  not  hesitate  to  let  me  know. 


If  you  have  any  questions, 
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SECTION  5 
HOME  HEALTH  COST-EFFECTIVENESS  SUMMARY 


Results  -  The  Home  Health  Cost-Effectiveness  Summary  concisely  lists  3k   studies 
of  home  care's  cost  savings  as  home  health  care  is  compared  with  other  forms 
of  intermediate  and  long-term  care.  The  studies  cited  are  from  a  study  of 
current  literature  in  the  field  in  I98O. 

Discussion  -  The  Summary  is  included  in  the  Users'  Guide  as  as  a  way  of  showing 
the  various  methodologies  and  results  of  cost  studies  conducted  on  home  health 
services.    It  is  important  to  note  that  there  is  wide  variation  in  cost-savings 
figures,  reflecting  the  many  differing  methods  and  opinions  of  experts  as  they 
try  to  compare  the  costs  of  home  care  with  costs  of  hospital  and  nursing  home 
care.   Part  of  the  problem  comes  from  the  difficulty  of  quantifying  the  psychological 
benefits  claimed  by  home  care  proponents  and  of  finding  a  way  to  evenly  apply  costs 
when  patients  show  wide  variation  in  care  required  and  diagnoses. 

Methodology  -  None.  Data  presented  is  for  reference  only. 
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HOME  HEALTH  EVALUATION  PLAN 


Introduction 

Although  home  health  care  has  just  lately  come  into  the  spotlight  as  an  in- 
creasingly important  part  of  the  total  health  care  system,  a  form  of  home  health 
services  was  organized  as  early  as  100  A.D.   A  group  called  the  Deaconesses  pro- 
vided care  for  sick  people  living  in  Roman  slums.   During  the  Crusades,  groups 
such  as  the  Order  of  St.  Anthony's  and  Lazerus  Order  provided  nursing  services  In 
homes.   The  trend  of  religious  groups  providing  home  health  care  continued  until 
1859  when  William  Rathbone,  impressed  by  home  care  given  his  terminally  ill  wife, 
promoted  the  idea  of  a  visiting  nurse  service  in  Liverpool,  England.   Rathbone  has 
been  credited  for  the  beginning  of  public  health  nursing  services. 

The  slow  growth  of  home  health  care  in  the  past  has  been  blamed  on  its  initial 
dependence  on  philanthropic  monies  and  the  start  of  the  Blue  Cross  program,  which 
paid  for  only  hospital  care  and  which,  it  has  been  argued,  established  America's 
dependence  on  hospital  care.   With  the  advent  of  Medicare  and  Medicaid,  home  health 
care  was  given  its  single  greatest  boost  and  is  now  growing  rapidly. 

Table  1 

Medicare  Reimbursement,  Reimbursement  for  Home 

Health  Services,  and  Number  of  Home  Health 

Visits  Under  Medicare,  Calendar  Years  1969-76 

(In  millions) 


Total  Medicare 

Home  Health 

Agency 

Home  Health 

Reimbursement 

Reimbursement 

Visits 

As  Percent 

Percent 

Percent 

of  Total 

Percent 

Year 

Amount 

Change 

Amount 

Change 

Medicare 
Reimburse- 
ment 

Number 

Change 

1969 

$6,276 



$  78 



1.24 

8.5 



1970 

6,748 

7.5 

62 

-21.2 

.91 

6.0 

-29.9 

1971 

7,459 

10.5 

57 

-  7.7 

.76 

4.8 

-20.5 

1972 

8,174 

9.6 

66 

16.1 

.81 

5.2 

9.2 

1973 

9,562 

17.0 

93 

40.8 

.97 

6.4 

22.3 

1974 

11,847 

23.9 

144 

54.7 

1.21 

8.2 

28.7 

1975 

14,652 

23.7 

216 

50.1 

1.47 

10.8 

32.0  • 

1976 

17,637 

20.4 

290 

34.3 

1.64 

13.3 

23.1 

Source:   Health  Care  Financing  Administration,  unpublished  utiliE!;ation  statics. 
Amounts  are  for  year  in  which  expenses  were  incurred,  based  on  bills  processed 
through  December  1977.   Thus,  data  for  most  recent  years  are  less  complete  than 
data  for  earlier  years. 
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It  is  estimated  that  approximately  14%  of  the  non- institutionalized  aged  need 
some  kind  of  home  help^°,  and  other  estimates  show  that  only  15%  of  the  projected 
national  need  for  home  health  services  is  being  met,  leaving  2.3  million  elderly 
people  in  need  of  home  health-*-"  services. 

Montana  had  17  licensed  home  health  agencies  which  had  a  total  operating  budget 
of  1.6  million  dollars  in  1979,  an  average  cost  per  patient  of  $374    (approximately 
$30.40  per  nursing  visit).   Eight  home  health  agencies  are  administered  by  local 
health  departments,  five  by  hospitals  and  four  by  independent,  non-profit  corpora- 
tions. 

Expansion  of  home  health  services  in  Montana  is  being  strongly  encouraged .   The 
Montana  State  Health  Plan  (1979-1980)  has  called  home  health  services  a  "viable, 
beneficial  and  cost-effective  alternative  to  institutional  care"  and  the  Health 
System  Plan  (1980)  says  that  "home  health  care  should  be  available  and  easily 
accessible  to  all  Montanans". 

The  increasing  demand  has  raised  interest  in  the  evaluation  of  existing  home 
health  services  at  the  local  level,  resulting  in  a  two  year  grant  evaluation 
project,  the  Community  Health  Services  Evaluation  and  Planning  Project,  which 
began  in  1979.   The  project  is  designed  to  provide  evaluation  methodologies  and 
data  for  eight  public  health  programs.   The  Missoula  City-County  Health  Department, 
under  contract  with  the  State  Health  Department,  is  responsible  for  developing 
evaluation  models,  testing  the  methodologies,  refining  them  as  necessary,  and  then 
distributing  "user  guides"  to  the  State  and  local  health  departments  for  use  in 
their  internal  evaluations.   The  Home  Health  Evaluation  Model  will  be  designed 
so  that  health  departments  may  use  all  or  parts  of  the  methodologies  to  construct 
management  and  planning  data  for  their  programs. 

LITERATURE  SEARCH 

There  is  a  good  deal  of  published  information  about  home  health  services,  most 
of  which  is  concerned  with  home  health's  cost-effectiveness  and  its  place  in  the 
long-term  care  system. 

Although  the  literature  shows  some  disagreement,  it  is  generally  agreed  that  home 
health  care  is  less  expensive  than  hospitalization.   Little  information  is  available 
about  home  health's  intangible  benefits  such  as  patients  remaining  in  their  own 
homes  and  evaluation  of  home  health  programs  is  almost  unknown  in  the  literature. 
A  brief  review  of  some  of  the  more  pertinent  literature  follows: 

Seidl,   F.J   Austin,    C,  Looks  at  analysis  of  cost  in  terms 

Green,   D.      "Is  Home  of  costs  of  alternative  services. 

Health  Care  Less  identification  of  clients,   case 

Expensive?"  management,   efficiency  and  quality 

of  service  and  the  payor  of  the 
alternative  service.      Concludes   that 
until  studies  use  the  five  categories 
listed,    "arguments  for  home  health  care 
hojsed  on  cost  are  for  the  most  part 
unfounded  and  should  be  avoided  by  those 
1  who  wish  to  advocate   (HH)  services." 


(* 
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Daubert,  E.  "A  System  to 
Evaluate  Home  Health  Cave 
Services " 


Describes   the  methodology  of  a  patient- 
care  review  program,  which  used  a  record 
audit  to  review  28  criteria  and  showed  a 
77%  decrease  in  deficiencies  in  patient 
care . 


~) 


Kisten,   H.,  Morris,    R. 
"Alternatives  to  Institutional 
Care  for  the  Elderly  and 
Disabled" 


Hammond,   J.      "Home  Health 
Cos t/Effeativeness :     An 
Overview  of  the  Literature' 


Doherty,   N.   Hicks,   B. 
"Cost-Effectiveness  Analysis 
and  Alternative  Health  Care 
Programs  for  the  Elderly" 


Explores  the  concept  of  inappropriate 
use  of  nursing  homes  for  patients  who 
could  have  been  served  in  their  homes. 
Points  out  that  the  Massachusetts  State 
Health  Department  estimated  that  only  Z7% 
of  the   100,000  patients  in  licensed 
nursing  homes  needed  full-time,   skilled 
nursing  care. 

Reviews  available  literature  concerning 
home  health  cost- effectiveness  and 
suggests  that  home  health  care  is 
less  expensive  than  extended  hospitaliza- 
tion in  the  view  of  third  party  payors. 
Available  information  also  indicates  that 
the  costs  of  home  health  care  and  nursing 
home  care  are  approximately  equal  for 
patients  requiring  the  same   level  of  core. 

Describes  a  technique  for  determining 
cost-effectiveness  of  alternate  health 
care  programs.     Stresses  comparison  of 
programs  against  outcome  criteria. 


Special  emphasis  in  this   evaluation  project  was  given  to  the  data  needs  of  home 
health  program  administrators  in  order  to  determine  what  evaluation  information 
would  be  of  the  most  use  to  them  and  their  programs. 

•  David  Feffer,  Health  Officer;  Crystal  Day,  Nursing  Director, 
Missoula  City-County  Health  Dept.,  Missoula,  MT 

•  Edward  King,  Health  Officer;  Jackie  Stonnel,  Nursing  Director, 
^       Gallatin  City-County  Health  Department,  Bozeman,  MT 

•  George  Sheckleton,  Health  Officer;  Jan  Treml,  Deputy  Health  Officer, 
Yellowstone  Health  Department,  Billings,  MT 

•  Bruce  Mclntyre,  Health  Officer;  Audry  Gonzales,  Nursing  Director, 
Flathead  City-County  Health  Department,  Kalispell,  MT 

•  Bill  Burke,  Health  Officer,  Cyrilla  Meade,  Home  Health  Director, 
Silver  Bow  Health  Department,  Butte,  MT 
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•  Camilla  Flamming,  National  Council  of  Homemakers  and  Home  Health 
"^              Aides,  New  York,  NY 

•  Bill  Halamandaris-  Ron  Kolanowski,  National  Association  for  Home 
Health  Agencies,  Washington,  DC 

METHODS  OF  PROCEDURE 

The  majority  of  home  health  patients  are  65  years  of  age  or  older.   Analysis 
of  the  size  of  the  elderly  population  shows  there  were  32.8  million  elderly  in 
1977,  nearly  a  seven-fold  increase  from  1900,  when  there  were  A. 9  million  elderly. 
Current  Census  Bureau  projections  show  a  40%  increase  in  the  total  population 
from  1977  to  2035,  compared  to  an  over  100%  increase  in  the  number  of  elderly 
in  the  United  States.   Home  Health  administrators,  then,  must  be  concerned  not 
only  with  the  quality  and  efficiency  of  their  current  programs,  but  also  must 
plan  their  programs  to  handle  the  demands  of  the  future. 

This  evaluation  is  designed  to  answer  not  only  quality  questions,  but  also  to 
examine  some  cost-effectiveness  issues  of  alternate  long-term  care.   Evaluation 
objectives,  established  to  measure  attainment  of  goals,  are  listed, with  explanations 
of  the  rationale  for  each  objective,  methodology  to  be  used  in  measuring  the  evalua- 
tion, and  uses  of  resultant  data. 

OBJECTIVES 

1.  To  provide  home  health  services  to  12   patients  per  1000  population  in  S^*^ 
'~^         FY  19Si. 

2.  To  provide  home  health  services  which  effectively  meet  patients' and  their    c^eC'^'^ 
families'  needs  for  type,  quality  and  availability  of  services.  ^ 

3.  To  determine  the  financial  impact  of  providing  home  health  services  to  ggc't'^'^^ 
the  community. 

4.  To  determine  the  costs  of  providing  home  health  services  per  diagnosis,  „  gt^oT^- 
per  visit,  per  case  and  per  average  number  of  visits. 

5.  To  conduct  home  health  nursing  audits  accurately  reflecting  quality  of  ^ 
patient  care. 

Objective  1:   To  provide  home  health  services  to  12   patients  per  1000  population 
in  FY  19gJ. 

Rationale;   Generally,  estimates  show  that  approximately  14%  of  the  aged  are  in 
need  of  home  health  services  (Shanas^^*^^) .   Although  there  is  no  generally  accepted 
way  to  determine  the  number  of  potential  home  health  clients  in  an  area,  assumptions 
of  12  per  1000  appear  to  be  reasonable  (Montana  Health  Systems  Agency,  1981).   On 
a  county  level,  many  home  health  administrators  feel  that  their  programs  are  not 
reaching  enough  of  the  population  in  need.   For  example,  Missoula  home  health 
agencies  currently  serve  about  100  patients  per  month,  but  according  to  the 
12  per  1000  estimate,  there  are  approximately  900  people  in  need  of  services. 
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Methodology:   since  home  health  programs  depend  on  calls  for  service,  referral 
patterns  are  important.  Tracking  referrals  to  home  care  will  be  an  important      r^ 
measure  of  whether  public  information  and  other  efforts  to  inform  potential        ^ 
patients  and  the  medical  community  are  working.  A  referral  log  will  be  kept       S 
to  summarize  referral  forms  to  record:   referral  source,  action  taken  on  followup,  g 
appropriateness  of  referral  and  reason  if  any  patients  do  not  receive  home  health 
care  after  a  referral.  A  protocol  will  be  developed  to  determine  the  level  of 
"appropriateness"  of  each  referral.  "^ 

O 

Different  methods  of  increasing  public  information  and  referrals  will  be  tried  "^ 
and  their  results  will  be  tracked  on  the  referral  log  by  number  of  appropriate  g 
referrals.  ^ 

In  addition,  a  personal  survey  of  hospital  discharge  planners  and  selected  ^^ 
physicians  will  be  conducted  to  determine  reasons  for  referring  patients  to  home  j^ 
care  and  reasons  why  other  patients  are  not  referred.  The  survey  will  ask  about  .^ 
their  perceptions  of  home  health  services,  if  any  patients  reported  back  about  "^ 
their  experience  with  home  care,  how  planners  base  their  discharge  recommendations, 5^ 
and  how  they  feel  home  care  fits  into  the  health  care  system. 

Use  of  Data:   Especially  if  new  or  additional  emphasis  is  placed  on  home  health's 
public  relations,  referral  patterns  seem  to  be  the  best  way  to  track  the  effects 
of  public  relations.   Information  from  the  physician  and  discharge  planner  survey 
can  determine  whether  or  not  those  sources  understand  and  are  willing  to  utilize 
home  health.   If  problems  exist,  then  further  efforts  can  be  made  to  solve  problems 
of  non-utilization. 

Objective  2:   To  provide  home  health  services  which  effectively  meet  patients ' 

and  their  families'  needs  for  type,  quality  and  availability  of 

services. 

Rationale:  Home  health  services  include  not  only  skilled  nursing,  personal 
care,  referral  to  community  resources,  such  as  homemakers,  home  chores,  and 
nutrition  programs,  but  also  direct  communication  with  patients  and  their  families. 
Evaluation  of  nursing  care  is  covered  by  the  four  times  per  yearly  audits  as 
required  by  federal  regulations.   This  objective  is  designed  to  see  what  patients 
think  about  their  home  health  care  and  to  insure  that  program  managers  have  the 
necessary  information  to  effectively  meet  patient's  perceived  needs.  Although  it 
would  be  valuable  to  measure  intangible  benefits  of  home  health  care,  it  is  almost 
impossible  to  assign  a  value  to  healing  faster,  being  able  to  stay  in  one's  own 
home,  etc. 

Methodology:  Two  mail  surveys  will  be  utilized.  One,  to  be  mailed  directly  | 
to  newly  discharged  patients  (capable  of  filling  out  a  questionnaire) ,  will  ask 
questions  about  how  the  patient  felt  about  the  length  of  the  nurse's  visit,  the 
clarity  of  patient-nurse  communication,  how  the  nurse  is  perceived,  and  quality  "^  (^ 
of  services.  The  other  questionnaire,  to  be  mailed  to  the  patient's  family  if  ^^  ^ 
the  patient  is  unable  to  respond  because  of  death  or  disability,  will  ask  for  the  ^f^ 
same  information  as  the  patient  survey. 
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The  confidential  surveys  will  be  designed  to  show  the  length  of  time  spent  on 
'^.'    home  health  and  the  patient's  diagnosis  in  order  to  determine  whether  different 
medical  conditions  affect  patient  response.   A  pre-test  currently  underway 
indicates  a  better  way  to  conduct  the  survey  would  be  to  survey  all  patients 
on  home  health  in  a  one  week  period  in  order  to  get  sufficient  numbers  from  which 
to  draw  conclusions.   (See  pages  9  and  10  for  sample  surveys.) 

In  conjunction  with  the  patient  and  family  surveys,  personal  interviews  will  tvj 
be  conducted  with  a  sample  of  physicians  who  (1)  consistently  refer  patients  to  ^ 
home  health,  (2)  have  referred  only  a  few  patients  to  home  health,  and  (3)  have  .§ 
never  referred  any  patient  to  home  health.  This  short  interview  will  see  if  tj 
physicians  understand  home  health  care,  what  they  think  of  care  their  patients  c^ 
have  received  and  reasons  for  not  referring  patients  to  the  program. 

Use  of  Data:  The  information  provided  by  Objective  2  will  suggest  areas  of 
needed  improvement  of  services  as  well  as  give  program  managers  an  idea  of  which 
parts  of  home  health  are  particularily  appreciated  by  users  and  physicians. 
Although  the  main  reason  for  surveys  is  information,  an  additional  benefit  is 
often  the  favorable  image  projected  by  an  agency  perceived  as  truly  concerned 
with  the  quality  of  its  services. 

Objective  3:  To  determine  the  financial  impact  of  providing  home  health  services 
to  the  community. 

Rationale:   A  considerable  share  of  the  home  health  literature  concerns  cost 
effectiveness.   It  is  generally  agreed  that  home  health  care  is  less  expensive 
y    than  hospital  or  nursing  home  care  in  certain  instances,  and  has  the  potential 
to  be  more  expensive  in  cases  of  long-term,  severe  disability.   Studies  show 
savings  that  range  from  $187  per  patient  (Berger^^)  to  $2,175  (Conn.  Blue  Cross 2'^) 
estimated  on  early  hospital  discharge  to  home  health  care;  and  $263  (Greenberg^^) 
to  $1,495  per  patient  on  home  care  ys  nursing  home  care. 

Several  authors,  most  notably  Gerson  and  Hughes^^  argue  that  the  only  costs 
relevant  in  an  economic  comparison  of  the  two  modes  of  treatment  are  those 
attributable  to  the  direct  care  of  the  patient.  When  they  compared  two  similar 
diagnoses,  there  is  basically  no  difference  in  cost  between  home  care  and  hos- 
pital treatment.   For  review  of  relevant  cost  analysis,  see  pages  11  through  20. 

Methodology:  In  order  to  accurately  determine  the  financial  impact  of  public 
health's  home  health  programs,  several  contingencies  must  first  be  met:  first, 
similar  diagnoses  must  be  compared  between  home  health  and  long-term  care;  ^^ 
second,  similar  patient  characteristics  (financial,  living  arrangements,  etc.)  ^ 
must  be  compared;  and  third,  all  relevant  costs  of  care  must  be  considered.  To  .^ 
show  these  factors,  a  table  will  be  constructed  to  show  each  input  for  each  +; 
different  patient  case  with  the  end  result  a  dollar  figure  comparing  home  health  ^ 
with  hospitilization  (especially  early  discharge)  and  nursing  home  care. 
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Use  of  Date:   A  caution  must  be  noted  here  -  this  data  will  be  of  use  to  program 
administrators  because  of  its  application  to  Montana  programs  and  how  home  health 
costs  can  be  determined  for  Montana  patients.   (It  remains  to  be  seen  if  these 
cost  figures  will  compare  to  national  and  large  urban  data.)   These  cost  figures 
can  not  cover  the  "intangibles"  of  home  health  care,  i.e.  the  psychological 
benefits  of  patients  staying  in  their  own  homes  in  familiar  environments,  with 
emphasis  on  family  relationships  and  patient  dignity.   The  argument  has  been 
made  that  in  the  movement  to  show  the  benefits  of  home  care,  only  visible  costs 
are  shown.   This  evaluation  recognizes  the  importance  of  intangible  benefits, 
but  currently,  no  method  is  available  to  include  them. 

Objective  4:   To  determine  the  costs  of  providing  home  health  services  per  diagnosis. 
pe^^  visit,  per  case  and  per  average  number  of  visits. 

Rationale:  Home  health  audits  (such  as  the  Medicare  Cost  Report)  provide  data 
on  cost  per  visit  and  per  discipline  but  many  program  administrators  need  additional 
general  information,  including  data  on  the  "average  patient"  served  by  their 
agency.  The  average  patient,  a  composite  of  all  data  for  separate  diagnoses, 
lengths  of  service  and  cost  of  supplies  and  nursing  time,  will  give  a  thumbnail 
sketch  of  what  cost  and  length  of  time  on  service  can  be  expected  when  a  patient 
with  "x"  medical  condition  Is  accepted  in  the  program. 

Methodology:   The  procedure  for  determining  the  average  patient  profile  will 
closely  follow  the  National  League  for  Nursing's  1974  study-^^  showing  the  average 
home  health  patient  in  large  urban  areas  to  be: 

•  69  years  old 

•  female 

•  referred  by  a  hospital 
9   served  for  36  days  ^ 

•  on  home  health  for  circulatory  or  "^ 
neoplasm  as  the  primary  diagnosis  ^ 

•  discharged  from  home  health  because  "-'^ 
of  recovery  or  stabilization  I 

The  NLN  utilized  a  discharge  summary  (see  page  2l)  which  can  be  used  by  evaluators  g^ 
to  provide  summary  data  for  study  purposes  or  included  on  existing  forms  and  g' 
summarized  later.  f^ 

Cost  information  will  be  provided  by  completing  "cost  analysis"  worksheets  for 
a  sample  of  cases  and  diagnoses  similar  to  those  developed  for  communicable 
disease  and  which  includes  both  direct  and  indirect  personnel  costs,  costs  of 
providing  nursing  supplies  and  travel. 

Use  of  Data:   Whether  involved  in  health  planning,  budgeting,  staffing  or  pre- 
paring public  information,  program  managers  can  use  cost  data  to  track  either  one- 
year  costs  or  long-term  changes.   Often  listed  as  the  most  important  program 
information  to  have,  cost  data  is  probably  the  most  important  component  of  a 
public  health  program. 


|t 
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Objective  5:   To  conduct  home  health  nursing  audits  accurately  reflecting 
^   quality  of  patient  care. 

Rationale:   Measuring  nursing  quality  is  difficult  because  of  great  variability 
not  only  in  patient  needs,  but  also  among  judges  of  quality.   The  nursing  pro- 
fession has  developed  peer  review  and  the  nursing  audit  as  two  ways  of  self- 
regulation  and  of  insuring  quality  of  patient  care. 

In  the  home  health  field,  federal  regulations  require  that  a  nursing  audit  be 
conducted  four  times  per  year.   Generally,  home  health  agencies  respond  by  using 
a  developed  audit  tool  applied  by  independent  nurses  on  contract  to  review  the 
nursing  quality  of  closed  cases.   Use  of  a  particular  audit  tool  is  not  specified 
by  the  regulations. 

Methodology:  Although  it  is  generally  agreed  that  nursing  audits  are  important, 
there  are  a  good  many  ways  to  audit.  A  survey  will  be  taken  of  all  in-state  and  '""' 
selected  out-of-state  home  health  agencies  to  review  each's  audit  tool  and  the  § 
advantages  and  disadvantages  of  each.  The  audits  will  be  reviewed  by  home  health  +i 
professionals  and  analyzed  for  efficiency  in  use  and  results.  A  listing  will  be  ^ 
compiled  to  show  available  audits  and  results  of  the  review.  ^ 

Use  of  Data:   information  on  available  audit  tools  and  the  successes  of  each  in 
a  home  health  setting  will  be  of  value  to  program  managers  who  are  either  looking 
for  a  new  audit  system  or  who  are  interested  in  comparing  their  present  audit  to 
those  used  by  other  agencies. 

)  IMPLICATIONS  OF  EVALUATION 

The  design  of  the  Home  Health  Evaluation  Plan  allows  for  individualization  of 
its  information  and  procedures  to  fit  express  needs  of  health  departments. 
Administrators  can  use  all  or  parts  of  the  evaluation  as  needed,  Missoula's 
final  evaluation  results  will  be  available  to  any  administrator  who  would  like 
to  use  the  data  as  a  comparision  or  as  a  reference. 

Although  the  evaluation  is  designed  to  use  already  existing  documents  as  much 
as  possible,  there  could  be  some  changes  necessary  in  procedures  and  staff  time 
needed  to  complete  the  evaluation  work.   As  staff  become  familiar  with  procedures, 
use  of  employee  time  will  diminish. 

Since  most  of  home  health  literature  is  concerned  with  large  urban  areas  and 
proprietary  or  hospital-based  home  health  agencies,  consideration  should  be  given 
to  publication  of  results  of  the  home  health  evaluation. 


^J.   S.  Hand 
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INTRODUCTION 

Explanation  of  Evaluation  Project  -  This  Users'  Guide  demonstrates  four  ways  to 
evaluate  your  Subdivision  Review  Program  —  from  a  cost  analysis  to  sewer  failure 
records.   The  evaluation  methodology  is  a  result  of  the  two  year  Community  Health 
Services  Evaluation  and  Planning  Project,  conducted  from  1979  to  1981  by  the 
Missoula  City-County  Health  Department, 

The  evaluation  project's  goal  is  to  provide  practical,  efficient  evaluation 
methods  that  public  health  administrators  can  use  when  evaluating  their  own 
programs. 

Scope  of  Subdivision  Review  Program  Evaluation  -  Because  measuring  both  outcome 
(sewer  failures)  and  process  (time  taken  for  processing  submittals)  is  important 
to  many  program  administrators,  this  evaluation  shows  methods  for  both. 

Each  evaluation  methodology  is  designed  to  smoothly  fit  into  your  health  depart- 
ment's existing  program  and  to  produce  clear  and  immediately  usable  data.   Because 
the  Missoula  Health  Department  was  the  test  site  for  this  evaluation  model,  the 
examples  shown  in  this  Guide  are  based  on  Missoula's  program  and  data.   You  may 
need  to  modify  some  parts  of  the  evaluation  to  fit  your  program's  features  or 
expand  the  evaluation  to  other  disease  programs. 

Each  section  of  the  Guide  shows  Misosula's  results,  discusses  evaluation  procedures, 
reviews  evaluation  models  and  provides  forms  used  to  collect  data.   The  Montana 
Subsurface  Treatment  and  Disposal  System  Failure  Survey,  the  Cost  Analysis  Worksheets, 
and  the  Action  Log  are  all  copy-ready. 

Changes  from  Original  Evaluation  Plan  -  An  evaluation  plan  is  only  a  brief  outline 
of  proposed  work.   Parts  of  the  original  Subdivision  Review  Evaluation  Plan  proved 
infeasible,  so  they  were  revised.   This  includes  the  Action  Log  mentioned  in 
Objectives  1,  3  and  k.      Both  a  suggested  formfor  an  Action  Log  (page  ^•'^)    and  a 
Time  Sheet  format  (page  A. 3)  are  provided  in  Section  k.      The  Missoula  Health  Depart- 
ment preferred  their  own  time  sheet  format  because  that  form  had  been  in  use  for 
several  years  and  staff  was  familiar  with  it. 
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SECTION  1 

SEWER  SYSTEM  FAILURES  -  AN 
OUTCOME  MEASURE  OF  INSPECTIONS 

Results  -  Before  the  Sewer  Failure  Record,  the  Missoula  Health  Department  did  not 
keep  reports  on  system  failures.   During  the  test  period  (FY  I98I)  of  this  evaluation, 
Missoula  had  six  sewer  system  failures.   They  were  each  analyzed  and  recorded  on 
the  failure  form.   One  copy  of  each  failure  record  was  sent  to  the  Subdivision 
Bureau. 

Analysis  of  the  failure  records  showed  that  two  failures  could  be  attributed  to 
an  incomplete  inspection,  and  the  rest  were  operation  failures  (alteration  of 
house  size,  improper  ground  cover  over  system,  industrial  failure  caused  by  grease 
emul si f icat ion,  and  system  undersizing  due  to  faulty  soil  classification).   A 
staff  meeting  was  held  and  problems  pinpointed  by  the  evaluation  were  discussed. 

Discussion  -  The  strength  of  keeping  records  about  location,  type,  soil,  reason,  and 
description  of  failures  is  historical.   Over  a  year  or  more,  trends  can  appear 
illustrating  specific  problems.   For  example,  if  a  proportionately  high  number  of 
incomplete  inspections  are  cited  as  reasons  for  failure,  then  more  staff  training 
could  be  needed.   If  a  large  number  of  sewer  failures  result  from  improper 
maintenance,  a  consumer  information  sheet  could  be  produced  to  show  owners  how  to 
maintain  and  use  their  septic  systems. 

Methodology  -  Each  time  someone  applies  for  a  replacement  permit,  fill  out  a  Sewer 
Failure  Survey.  Keep  one  copy  in  a  historical  file  and  send  one  copy  to  the  State 
Subdivision  Bureau  for  inclusion  in  a  state-wide  information  system. 

Each  quarter  (or  monthly,  semi-yearly,  or  yearly),  a  program  manager  should  review 
the  file  to  see  what,  if  any,  actions  should  be  taken  to  correct  any  consistent 
problems  the  sewer  failure  form  brings  to  light. 


MONTANA  SUBSURFACE  TREATMENT  &  DISPOSAL  SYSTEM 
FAILURE  SURVEY 


date  installed/reported  failed 


owner's  name: 
section,         , 

permit  § 

replacement  permi 

address: 

T      N,  R         W  installer: 

^  OF  SYSTEM  (Please  specify  size  of  tank,   amount  of 
etc.    or  provide  copy  of  permit) 

.  .  .  (   1  metal      |   |  concrete     |   |  plastic 

t  # 

TYPE  OF  DESCRIPTIOI 
1   1  septic  tank  .  , 

drainfield. 

1   1  seepage  pit  .  , 

.  .  .  size  

1   1  drainfield  .  , 

.  .  .  length_ 

depth 

to  bottom  pipe 

1   1  other 

SOIL  DESCRIPTION 
soil  type: 

system  located  in:    |   |  fill  material             |   |  native  material 

minimum  depth  of  groundwater  at  drainfield  site 

has  this  area  ever  been  flooded?  |   lyes  ...  if  yes,  why? 

□  no 
PROBABLE  REASON(S)  FOR  FAILURE  (Please  rank  appropriate,   using   "1"  for  most  important 


Drainfield 

I  I  high  water  table 

I  I  impervious  soils 

I  I  steep  slopes 

I  I  under-design 

I  I  improper  construction 

I  I  depth  draintile 

I  I  over-use 

I  I  age 

I  I  other:  


I,    "2"  for  second  most  important,   etc.) 
Septic  System 

I   I  lack  of  pumping 

I   I  age 

I   I  baffles 

I   I  over-use 

I   I  septic  tank  collapse 

I   I  other: 


DESCRIPTION  OF  FAILURE 


DESCRIPTION  OF  REPLACEMENT  SYSTEM 

name  installer 

date : 

form  completed  by:  


type_ 
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SECTION  2 

COST  OF  THE  SUBDIVISION  REVIEW  AND 
CERTIFICATE  OF  SURVEY  PROGRAMS 

Results  -  Missoula's  Subdivision  Program  costs  $28,512  in  fiscal  year  I98O.   This 
included  $19,7^8  for  personnel  costs,  $835  for  water  tests,  and  $7,929  for  mileage, 
training  and  department  overhead  costs.   It  is  estimated  that  fical  year  198rs  costs 
(due  August  198l)  will  be  about  the  same  or  lower  because  fewer  plats  and  certificates 
of  survey  were  submitted. 

Discussion  -  Information  used  to  complete  the  cost  analysis  is  easy  to  collect.   The 
Action  Log  (Section  k)    provides  the  amount  of  time  and  mileage  spent  on  each  sub- 
mittal.  To  be  as  accurate  as  possible,  program  costs  should  come  from  the  Log. 
You  can  use  estimates,  but  the  analysis's  over-all  accuracy  will  be  reduced. 

The  cost  information  can  be  easily  calculated  each  year  and  used  to  project 
program  costs  for  budgeting  and  program  planning. 

Methodology  -  See  the  detailed  explanation  on  the  back  of  the  program  costs  analysis 
(page  2.A). 


Section  2,  Page  1 
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OVIRHFAD 
Hejilh    Di:()ai-tnient    Cost    An.: 


i,.r,i:,i   l.i'  .Liamitic   the  oocriiead,    or    "c-oui  of  (Llyu-i  /■,\(.'w- n.'i;j,  " 

on  a  i'ci\.;jnLi<ie  bash;   so    that  overhead  routs  can  he  j'airL'i  a/ Inr-ai- 

to  carh  ]wti\;ular  health  department   prn.jram. 


1  .       Administrative    Sal  ■tries 
a.    Health   Officer 


b.  Administrative  Assistant 

c.  Administrative  Secretary 

d.  H.D.  Receptionist 
c.  H.D.  Accountant 

f  Vital  Stat ist  ics  flerk 


2.   Other  Administrative  Personnel  Expenses 

a.  Teinination  Reserve  


b.  Rec  ru  i  tinent 

c.  General  Conferences  f.  Meetings 

d.  General  Traininq 

e.  General  Books  t  Periodicals 

f.  Administrative  Tr.jvel 


;2-.^ 


Overhead 

H.D.    Cost    An<i  lysis 

Pqgc-    2 


3.   Other  Admi ni s t rat i vo  Expenses 

a.  Al I  Office  Suppl ies 

b.  Al 1  Copies  and  Printing 

c .  All  Postage 

d.  Office  Equi[)ment  £  Maintenance 

e.  All  Telephone  Charges 

f.  Interc'-.l  on  Warrants 


JcT" 


h.       Building  and  Maintenance 


Rent  OK  $ per  sq.  foot 

X,  number  of  sq.  feet  of  office, 


d.  Insurance 


5.   Other  Overhead  Expenses 
Other: 


bui  tding  and 


TOTAk.  OVERHEAD  COSTS 


CZ] 


Overhead  Computation  =  -,^-h.  £  ,  \^,  ^.fel  I    fringe    =   "^"""^^  ^^°''^ 


2.3 


OVERHFAD 
[tealth  Department  Cost  Analysi 


'h'cfh'.'iil   ■;■;;  ,i  J'uctuf  denigiicd  to  ctilculaU:   the    total   rosts   of  'uimin- 
■! ::! ci'inn  a  yvoavwn.       !t  should  be  noted   that  overhead   is  an  estimatior 
:ij'  ihi    h(\il  tli_  dri'ay I rih^ntjji  administration  of  all  department  progra/'ir , 
;//  rf  hihii-h  ^nhfla)  ;   hciiirc,    the  need  for  an  ooerhrad  firjure. 


Ihi',  iiiiMir-.  ■..jl.jr  i  I",  plus  appropriate  yearly  fririfu-  benefits  and  merit  raises 
of  only  personnel  involved  in  the  general  administration  of  llie  health  department. 
(Other  personnel  may  be  added  if  other  departments  are  organized  differently, 
for  example,  a  health  department  personnel  director  or  assistant  health  officer 
should  be  added  to  this  category.)   The  receptionist  is  the  person  who  acts  for 
I  he  entire  health  department,  the  general  office  clerk  (or  a  portion  of  her/his 
salary)  acts  as  vita!  statistics  clerk. 

To  calculate  (a),  or  total  administrative  salaries,  multiply  total  salaries 
(which  should  include  yearly  raises)  by  yearly  fringe  percentage. 

Other  Administrative  Personnel  Expenses 

"Termination  Reserve"  means  those  monies  set  aside  to  pay  vacation  and  sick  pay 
severance  to  employees  who  quit.   "Recruitment"  means  costs  budgeted  for  newspaper 
ads,  printing  and  other  costs  of  filling  vacant  positions.   "Conferences  and 
Meetings"  refers  to  those  of  genera  1  interest  to  health  administration  and  not 
applicable  to  a  specific  program.   "Training"  means  general  mangement  or 
adn.ini  strat  i  ve  training,  not  that  attributable  to  a  specific  program.   The  "Books 
>ind  Periodicals"  category  includes  general  health  planning,  public  health,  and 
management  materials  of  general  interest  and  not  attributable  to  a  specific 
program.   "Travel"  means  general  health  department  trips  and  excludes  travel  for 
specific  programs  or  conference  travel  (to  be  included  under  "Conferences  and 
Meetings").   Blanks  are  provided  for  other  categories  specific  to  the  general 
adnii  ni  st  rat  ion  of  a  health  department.   Add  all  these  categories  to  get  Total 
Adii.inistrat  ivc  Personnel  f-xpenses  (b). 

Other  Adiiiinist  ra  t  i  v>\_E,<pcMr.es^ 

Expenses  in  this  cotcgory  are  those  which  are  general  to  the  running  of  an 
agency.   Since  it  is  virtually  impossible  to  split  out  the  numbrr  of  pencils, 
|)icces  of  paper  and  the  like  used  by  one  program  or  activity,  it  is  a  good  deal 
easier  to  include  these  as  a  total  category  and  be  able  to  easily  allocate  them 
in  the  department  overhead  computation.   (The  only  exception  to  this  would  be 
grants  where  administrative  expenses  are  each  listed  and  funded  separately  and 
should  be  allocated  as  such.)   Office  supplies,  copies  and  printing,  postage, 
office  equipment  and  phone  are  total  costs  per  year  for  the  whole  department 
excepting  grant  allocations.   Interest  on  warrtints  is  interest  [)a  i  d  on  monies 
borrowed  from  a  bank  to  cover  current  department  operating  expetises  (if  applicable). 
Other  administrative  expenses  should  be  included  in  this  category  if  they  are 
attributable  to  the  general  operation  of  a  department.   (Note:   It  is  more  accurate 
and  easier  to  charge  vehicle  expenses  to  the  program  which  uses  them  on  a  cents- 
per-mile  basis.   It  is  also  a  good  deal  more  difficult  to  charge  phone,  office 
space  and  the  like  out  on  a  program-by  -  program  basis.) 

Building  and.  Ma  i  ntenance 

Housing  costs  ore    to  be  included  in  the  overhead  computation  because  of  the 
difficulty  of  allocating  square  footages,  utilities,  phones,  etc.,  to  each  program 
or  activity.   This  category  should  cover  all  housing  expenses  of  the  department 
and  laboratory. 


This  category  should  include  costs  of  routine  audits,  administrative  consul! 
!preciation  on  capital,  or  other  similar  items. 


for  FY 

actual 

estimated 


SUBDIVISION  PROGRAM 

Cost  Analys  i  s 

The  puppose  of  this  cost  analysis  is   to  provide  a  formula  to  determine 
the  costs   to  the  Health  Department  of  conducting  subdivision  review. 


1.  PERSONNEL 

a.  Sanitarian  time  x  (salary  +  fringe) 
PLAT 

COS 

b.  Clerical  time  x  (salary  +  fringe) 

c.  Engineer  time  x  (salary  +  fringe) 

d.  Other: 

2.  ENVIRONMENTAL  HEALTH  ADMINISTRATION  COSTS 

a.  Environmental  Health  Director 
PLAT 

COS 

b.  Other: 


COS 


2o.    Total  Personnel  Costs 


2d.   Total  Combined  PLAT  and  COS  Costs 


3.  MILEAGE  @    c/mile 


k 
5 
6.  OTHER 


TRAINING,  BOOKS  AND  PERIODICALS 

OVERHEAD  @   %  x  (total  salaries  +  fringe)  (2d) 


Total  Program  Cost 


PLAT 


l.k 
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PROCEDURE 
Subdivision  Program  Cost  Analysis 

Note:  Each,  health  department  has  its  aun  system  of  tracking  -personnel  and 
mileage  costs.      This  cost  analysis,   designed  to  provide  the  most  convenient 
method  of  determining  program  costs,   can  be  changed  to  reflect  the  department 
specific  situation.      The  Subdivision  Cost  Analysis  is  split  into  two  sections 
to  show  separate  costs  of  (1)  subdivision  plat  review  and  (2)   certificate  of 
survey    (COS)   review. 

1.  PERSONNEL:  There  are  three  ways  to  calculate  personnel  time:  (1)  from  the 
Action  Log,  which  gives  exact  time  spent  on  each  submittal,  (2)  from 
department  time  records,  or  (3)  from  estimates.   Personnel  time  should 
include  time  spent  on  the  telephone  and  other  less  obvious  time.   Use 
hourly  salary  figures  (or  an  average,  if  more  than  one  sanitarian  is 
involved  in  subdivision  review)  and  add  the  appropriate  fringe  benefit 
percentage. 


ENVIRONMENTAL  HEALTH  ADMINISTRATION  COSTS:   This  category  shows  direct 
administrative  costs  which  are  the  costs  of  directing  and  supervising  the 
program.   These  costs  can  be  calculated  as  a  percentage  of  total  program 
personnel  costs  (10^  is  a  good  rule-of-thumb)  or  from  time  records. 


3.  MILEAGE:   If  accurate  records  are  not  available,  mileage  can  be  calculated 
as  a  proportion  of  total  environmental  health  time,  or: 


Total  Subdivision  Program  Hours 
Total  Env.   Hlth.   Hours 


X% 


2.  X%  times  Total  Yearly  Mileage  =  Subdiv.   Program  Proportional 

Mileage 

k.  TRAINING,  BOOKS  AND  PERIODICALS:  These  should  be  only  costs  specific  to 
the  Subdivision  Program.  Costs  which  are  general  should  be  allocated  to 
Department  overhead  (see  Overhead  Cost  Analysis). 

5.  OVERHEAD:   This  category  provides  a  way  to  include  building,  maintenance, 
and  general  health  department  administration  (health  officer,  accountant, 
other  administrative  support)  in  program  costs.   See  Overhead  Cost  Analysis 
to  determine  health  department  overhead  percentage. 

6.  OTHER:   Any  other  costs  not  already  included  in  the  above  five  categories. 
(Such  as  laboratory  costs,  etc.) 


12/80  jsh 


For    FY  JO 
I     actual 

SUBDIVISION    PROGRAM  —/AU^'^ldi 


CosL    Ai^iaJ  y^ij>_ 

77;,/    rui'pr?:;:-:   cf   thi:^   c-:r,i    u>ul;ii.'-i-    v';;    ^■   /: 
//(,■?  '(•(>.: I::    i -.'■    the   He<ili>i   :'cj'ayi!iieni  cj'  |^•■'(' 

1.     PF.R  SONNE  L 
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SECTION  3 

WHAT  DO  OTHERS  THINK  OF  THE  SUBDIVISION  PROGRAM? 
AN  OPINION  SURVEY 

Results  -  The  Missoula  Subdivision  Survey  showed  that  a  high  percentage  of 
respondents  see  the  local  health  department  as  courteous,  fair,  and  professional, 
but  a  significant  percentage  also  see  the  department  as  inflexible,  slow,  inefficient, 
and  inconsistent.   Respondents  see  the  State  Health  Department  as  generally 
courteous^  knowledgeable,  but  also  overbearing,  inflexible,  slow,  inefficient,  and 
inconsistent.   Thirty-one  respondents  were  asked  questions  about  both  health 
departments'  attitudes,  procedures,  and  enforcement  and  gave  frank  answers  during 
personal  interviews.   (See  page  3-7  for  complete  report.) 

The  Missoula  Health  Department  used  the  Subdivision  Opinion  Survey  to  improve 
its  procedures  and  contacts  with  people  making  subdivision  submittals.   The  survey 
resulted  in  plans  for  a  monthly  newsletter  to  keep  submitters  current  with  rule 
changes,  new  requirements  and  rule  interpretations.   Staff  and  program  administrators 
discussed  survey  findings  to  see  where  they  could  improve  the  program. 

Discussion  -  Conducting  an  opinion  survey  Is  an  excellent  way  to  get  feedback  from 
other  agencies,  firms  and  individuals.   The  results  of  the  Missoula  Survey  were 
very  well  received  by  staff  and  administration  alike.   In  addition,  respondents 
like  the  idea  of  the  Health  Department  asking  for  their  input.   This  helps 
create  a  good  department  publ ic  image. 

If  your  department  does  not  have  an  experienced  survey  interviewer  to  conduct 
a  survey,  we  recommend  you  hire  one.   Personal  surveys  like  this  one  are  difficult 
to  conduct  because  so  many  of  the  responses  are  based  on  subjective  opinion. 
In  addition,  almost  each  individual,  firm,  and  agency  surveyed  could  have  different 
types  of  businesses  with  the  health  department  —  legal,  engineering,  real  estate, 
etc. 

All  responses  must  be  thoroughly  explored  and  the  interviewer  must  know  when 
to  tactfully  probe  for  more  information  if  a  respondent  hesitates  or  looks 
doubtful . 

Methodology  -  You  may  want  to  make  changes  in  the  questionnaire  if  it  will  not 
result  in  the  information  you  need.   If  you  do  want  to  add  or  change  questions, 
be  very  careful  that  they  are  very  specific  and  clear  (ambiguous  questions  will 
give  you  ambiguous  results),  and  be  sure  the  questions  are  not  biased  toward  a 
particular  response. 

1.   Sample  Size  — The  best  procedure  is  to  make  a  list  of  all  developers, 
surveyors,  realtors,  lawyers,  engineers,  geologists,  and  government 
agencies  who  deal  with  your  department  on  subdivision  review.   Then  rank 
each  with  a  "+"  for  people  known  to  be  positive  toward  the  department, 
"-"  for  people  known  to  be  negative  toward  the  department,  and  "0"  for 
people  who  probably  have  neither  positive  nor  negative  feelings.   Then 
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choose  at  least  three  from  each  category  of  developers,  surveyors,  realtors, 

etc.   Be  sure  that  you  have  one  negative,  one  positive,  and  one  neutral  /^ 

person  in  each  category.  ^ 

2.  Appointments  —  Send  a  letter  (sample  page  3.3)  to  each  potential  respondent, 
announcing  the  study  and  asking  for  an  appointment.  This  letter  insures  that 
respondents  are  aware  of  the  study  and  their  role. 

About  one  week  after  the  letter  is  mailed,  telephone  each  respondent  to  ask 
for  a  20  minute  personal  interview.   (Be  sure  to  allow  for  travel  time  between 
interviews  and  for  longer-than-expected  interviews.) 

3.  Interviews  —  Be  prompt.   You  are  using  some  of  the  respondent's  business 
time. 

Establish  rapport  with  respondent  before  conducting  the  interview.   Explain 
the  survey  again,  answer  questions  fully  and  stress  that  all  answers  you 
get  are  completely  confidential  — you  will  not  release  individual  answers, 
or  in  any  way  connect  respondents  with  their  answers.   Unless  the  respondent 
feels  secure  with  the  interviewer  and  with  confidentiality,  you  will  not 
get  honest  answers. 

Read  each  question  exactly  as  it  is  written.   Record  all  relevant  information 
and  comments. 


Conclude  with  a  sincere  thanks  for  the  respondent's  help  and  time. 

Compiling  Results  —  It  seems  easiest  to  first  tabulate  all  questions  with 
set  respondent  reply  categories,  close-ended  questions  (#1 ,2,3,/t  ,5,7  ,8,9  JO,  1 1  , 
12,13,14),  then  sort  questionnaires  into  piles  with  similar  responses  for 
each  question   (#6,11,12,14,15,16).   Count  each  "sort." 

Do  not  report  any  responses  that  come  from  only  one  or  two  respondents. 
This  preserves  confidentiality  and  adjusts  for  individual  bias. 

Analyze  results  and  write  report  for  Subdivision  Program  administrators 

and  a  shorter  summary  report  if  you  would  like  to  give  respondents  feedback. 


c 
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September  2,  1980 


...MAKIWG  A  DIFFERENCE. 


As  part  of  an  over-all  evaluation  of  the  Missoula  Health  Department's 
subdivision  review  program,  I  will  be  conducting  personal  interviews 
with  people,  firms,  and  other  agencies  who  deal  with  the  Department  on 
certificate  of  survey  and  subdivision  review  business.  I  would  like  to 
interview  you  about  the  review  rules.  Department  attitudes,  clarity  of 
instruction,  personnel  and  any  problems  you  have  encountered  with  the 
Health  Department. 

The  survey  is  being  conducted  by  the  Research  and  Evaluation  Unit  of 
the  Health  Department.  Survey  results,  to  be  held  in  strict  confidence, 
will  be  used  to  improve  the  subdivision  review  program. 

I  will  call  next  week  to  ask  to  set  up  a  20  minute  personal  interview 
with  you.  Your  helping  with  this  survey  will  mean  that  your  office  will 
have  input  in  improving  the  services  the  Health  Department  provides  and 
an  opportunity  to  offer  advice. 

Sincerely, 


Janice  S.  Hand 
Research  Specialist  II 
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OPINION  SURVEY 
SUBDIVISION  PROGRAM 


§  The  purpose  of  this  survey  is  to  find  out  hew  others  see  the  Em)iron- 
'~  menial  Health  iHvision  of  the   local  Health  Department.      The  Health 
y  Department  will  use  the  data  to  improve  its  procedures  and  correct  any 
"q  deficiencies  the  survey  reveals.      Your  answers  are  completely  con- 
i:  fidential  -  no  name  will  appear  on  the  questionnaire  and  I  will  not 
£  release  answers.     I  would  appreciate  your  frank  replies. 


In  general,  what  would  you  say  is  the  local  Health  Department's  main  concern? 
Would  you  say  the  Department  is  concerned  .  .  . 

only  with  the  environment, 

mostly  with  the  environment, 

mostly  with  rules  and  regulations,  or 

only  with  rules  and  regulations? 


In  general,  how  would  you  describe  the  local  Health  Department's  attitude 
toward  you  and  your  firm/agency?   For  instance,  would  you  say  the  Department 

is:  (Circle  category  nearest  response;   0  =  neutral.) 

OR 


overbearing 

f lexi  ble 

friendly 
gives  complete  info, 
gives  clear  info. 


lax 

uncompromi  sing 

unfriendly 

incomplete  information 

confusing  information 


3.   How  about  the  State  Health  Department? 

OR 

overbearing 

flexible 

friendly 
gives  complete  info, 
gives  clear  info. 


Would  you  say  they  are: 


lax 

uncompromi  sing 
unf iendly 

incomplete  information 
confusing  information 


/)- 


In  all  your  dealings  with  the  local  Health  Department,  do  you  feel  you  have  been 
treated: 


fairly? 
courteously? 

yes 
yes 

no 
no 

efficiently? 

yes 

no 

professional ly? 

yes 

no 

knowledgeably? 

yes 

no 

consistently? 

yes 

no 

l.^ 
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In  all  your  dealings  with  the  State  Health  Department,  do  you  feel  you  have 
been  treated: 

fai  rly?  yes  no 

courteously?  yes  no 

efficiently?  yes  no 

professionally?  yes  no 

knowledgeably?  yes  no 

consistently?  yes  no 

Speaking  of  certificate  of  survey  review,  what  benefits  do  you  see  from  the 
local  health  department  conducting  COS  review  rather  than  the  State  Health 
Department? 


Negative  aspects? 


7.   During  the  certificate  of  survey  review  process,  which  agency  do  you  see  as 
the  most  difficult  to  work  with?  (Check  one.)      The  easiest?  (Check  one.) 


Most 
Difficult   Easiest 


a.  local  health  department 

^]^       ^^^   b.  State  Health  Department 

c.  county  surveyor ' s  office 

"  ^^   d.  county  attorney's  office 

8.  Now,  speaking  of  subdivision  review,  do  you  feel  existing  subdivision  require- 
ments are  effective  in  protecting  the  ground  water? 

yes 

no 

9.  Do  you  feel  the  local  Health  Department  is  effectively  enforcing  existing 
subdivision  regulations? 

yes 

no 

10.   Compared  to  five  years  ago,  would  you  say  that  the  local  Health  Department  has 
improved,  stayed  about  the  same,  or  gotten  worse  in  its  general  subdivision 
review  process? 

improved 

stayed  same 

gotten  worse 


3.5 


Opinion  Survey 
Subdivision  Program 
Page  3 

11.   Are  there  parts  of  either  certificate  of  survey  or  subdivision  review  that  you 
find  particularly  unclear  or  confusing? 

yes—*-  


Do  you  feel  there  are  too  many  changes  in  subdivision  regulations  from  one  time 
to  another? 


13.   During  the  subdivision  review  process,  which  agency  do  you  see  as  the  most 
difficult  to  deal  with?  (Cirole  one.)      The  easiest?  (Cirole  one.) 


local  health  department 
State  Health  Department 
county  commissioners 
city  counci 1 

city-county  planning  board 
city-county  planning  staff 

I't.   Have  you  ever  had  any  problems  with  the  local  Health  Department  that  were  not 
resolved  to  your  satisfaction? 


Most 

Difficult 

Easiest 

a 

b 

c 

d 

e 

f 

yes- 


no 

With  the  State  Health  Department? 
yes — > 


15-   Who  do  you  usually  work  with  at  the  local  health  department' 
How  is  he/she  to  work  with? 


16.   What  suggestions  do  you  have  to  improve  Health  Department  relations  with  youi 
firm/agency  and  the  Health  Department's  information  and  enforcement  efforts? 


THANK  YOU! 

3-0  jsh  10/80 
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REPORT 

MISSOULA  SUBDIVISION  SURVEY 

SUMMARY 

The  Missoula  Subdivision  Survey  showed  that  a  high  percentage  of  respondents 
see  the  local  health  department  as  courteous,  fair  and  professional,  but  a 
significant  percent  also  see  the  department  as  inflexible,  slow,  inefficient, 
and  inconsistent.  Respondents  see  the  State  Health  Department  as  generally 
courteous,  knowledgeable,  but  also  overbearing,  inflexible,  slow,  inefficient, 
and  inconsistent.  Thirty-one  respondents  were  asked  questions  about  both  health 
departments' attitudes,  procedures  and  enforcement  and  gave  frank  answers  during 
personal  interviews. 

SURVEY  BACKGROUND 

The  Missoula  Subdivision  Survey  was  conducted  as  part  of  the  Community  Health 
Services  Evaluation  and  Planning  Project,  which  is  testing  evaluation  methodologies 
in  Missoula  County,  and  will  ultimately  provide  evaluation  tools  to  local  and 
the  State  Health  Departments.  The  survey,  part  of  the  Subdivision  Review 
Evaluation  Plan,  was  conducted  to  determine  how  other  agencies  and  firms  who 
deal  with  the  health  departments  on  subdivision  business  view  the  departments' 
procedures,  communications,  attitudes,  enforcement  and  staffs.  This  survey  is 
the  first  effort  in  Montana  to  gather  direct  feedback  on  subdivision  review  from 
users. 

Environmental  health  directors  generally  agreed  that  they  wanted  information 
about  how  people  see  their  health  department  and  suggested  the  following  types 
of  questions: 

t  health  departments'  enforcement  and  environmental 
protection. 

•  perceived  attitudes  of  the  health  departments 
toward  the  respondents. 

•  how  respondents  view  the  certificate  of  survey  and 
subdivision  review  process. 

•  how  each  health  department  compares  with  other 
agencies. 

•  clarity  of  review  requirements  and  regulations, 
t  unresolved  problems  with  the  health  departments. 

•  suggestions  for  improvements. 
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The  Missoula  Health  Department's  subdivision  program  is  staffed  by  one  engineer 
and  five  registered  sanitarians.  The  Department  currently  reviews  approximately 
16  certificates  of  survey  and  2  subdivision  submittals  per  month  and  deals  with 
approximately  50  firms,  individuals  and  agencies  per  year.  Current  census 
estimates  show  Missoula  County  has  a  population  of  72,000.  The  County  covers 
2,624  square  miles.  The  Study  was  conducted  in  Missoula  County  because  the 
Community  Health  Services  Evaluation  and  Planning  Project  is  contracted  with 
the  Missoula  Health  Department. 

STUDY  DESIGN 

The  study  was  conducted  by  one  researcher  who  interviewed  a  sample  of  firms, 
individuals  and  agencies  who  deal  with  the  Missoula  Health  Department  and  the 
State  Health  Department  (Subdivision  Bureau)  on  subdivision  submittals.  Because 
getting  frank  and  open  responses  was  imperative  to  the  success  of  the  survey, 
personal  interviews  at  respondents'  offices  were  chosen  as  the  survey  methodology. 

The  respondent  list,  carefully  chosen  to  rule  out  interviewing  only  people 
known  to  be  friendly  to  the  two  health  departments,  included: 

7  developers 

4  geologists 

3  lawyers 

7  engineers 

3  realtors 

3  surveyors 

4  representatives  of  local 
__  government  agencies 

31  =  n 

Interviews  took  about  20  minutes  each  and  were  conducted  from  September  15  to 
October  8,  1980. 

One  week  before  the  interviews  were  to  start,  a  letter  (see  page  3.3)  was 
mailed  to  each  potential  respondent,  announcing  the  study,  explaining  who 
was  conducting  the  survey  and  asking  for  a  20-minute  personal  interview. 
Telephone  calls  set  up  the  meetings. 

Of  the  original  list  of  35  potential  respondents,  31  were  interviewed.  Two 
respondents  were  not  interviewed  because  their  firm  preferred  they  be  represented 
by  the  third  staff  member  on  the  list,  and  two  respondents  were  not  locatable. 

Because  the  survey  covered  such  a  wide  range  of  professions,  wording  questions 
was  very   difficult.  The  main  purpose  of  the  questionnaire  was  to  get  the 
respondents  thinking  of  specific  areas  of  the  subdivision  process  and  since 
consistency  was  not  a  problem  (using  one  interviewer),  the  questionnaire  was 
an  "open"  one.  {Caution:   This  question  format  worked  because   (1)  a  trained 
and  experienced  interviewer  conducted  each  interview,    thereby  insuring  consistency 
in  asking  and  recording;    (2)    the  interviewer  routinely  questioned  respondent 
hesitancy,   getting  more  aorrvpleie  and  frank  responses;  and  (3)   the  open-ended 
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Questions    (fl4,    9,    10,    12,    13,    14)  were  carefully   tabulated  to  insure  consistenoij 
and  accuracy .      Under  normal  field  conditions,    this  methodology  may  not  work  so 
well.      To  insure  success,    efforts   to  duplicate   the  study  should  use  one   trained 
interviewer ,   or  results  could  he  severly  biased. ) 

A  common  concern  of  all  respondents  was  that  their  answers  be  confidential. 
This  issue  was  made  more  sensitive  by  the  fact  that  these  people  must  be  able 
to  maintain  good  working  relationships  with  the  health  departments.  Confi- 
dentiality was  a  priority  in  the  study,  somewhat  eclipsinq  results.  To  insure 
responses  were  truly  confidential,  no  identification  was  used  on  any  of  the 
survey  forms  (results,  then, could  not  be  analyzed  by  profession),  and  any 
responses  that  were  traceable  to  one  person  were  not  released.  Only  aggregate 
data  is  available  for  data  analysis. 


RESULTS 

When  asked  if  they  felt  the  Missoula  Health  Department's  main  interest  was 
protecting  the  environment  or  if  the  department  was  more  concerned  with  rules 
and  regulations,  respondents  generally  felt  the  health  department  fell  some- 
where inbetween.  Results  show  a  fairly  even  distribution  of  responses. 


Question  #1 

department 

more  concerned     i — 

with  environment   1( 


30% 


10% 


11%    Wo 


department 
more  concerned 
with  rules  and 
regulations 


Respondents  generally  felt  that  the  Missoula  Health  Department's  attitude 
toward  their  firm  was: 


t  neither  over-bearing  nor  lax  (92%) 

•  very  friendly  (90%) 

When  asked  about  information  they  had  received  from  the  Health  Department, 
59%  felt  the  information  was  complete  and  68%  felt  the  information  was  clear. 
Approximately  1/3  of  the  respondents  saw  the  Missoula  Health  Department  as 
uncompromising. 

Interestingly,  when  asked  the  same  question  about  the  State  Health  Department, 
respondents  saw  the  State  as  —  very  overbearing,  inflexible,  less  friendly  and 
more  liable  to  give  complete  information  (although  that  information  is  seen  as 
slightly  less  clear  than  information  from  the  local  health  department). 

Question  #2 

Health  Department  seen  as: 

neither  overbearing  nor  lax.. 

flexible. . 

friendly. . 

giving  complete  information.. 

giving  clear  information.. 


Ms  la 

State 

H.D. 

H.D. 

..31% 

..35% 

..69% 

.Ml 

..90% 

-.63% 

..59% 

..67% 

..68% 

..61% 
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Question  #3  asked  about  respondents'  perceptions  about  their  treatment  by 
the  health  departments,  and  generally,  respondents  thought  they  had  been 
treated  fairly,  very  courteously,  professionally,  and  consistently  by  the 
Missoula  Health  Department.  Almost  half  said  they  were  not  dealt  with  promptly 
and  about  40%  did  not  feel  they  had  been  treated  knowledgeably. 

Respondents  felt  they  were  treated  less  fairly,  less  courteously,  less 
professionally  and  less  consistently  by  the  State.  They  felt  their  treatment 
was  a  good  deal  less  prompt  and  efficient  by  the  State  than  the  local  health 
department,  but  said  they  felt  the  State  was  more  knowledgeable. 


Question  #3 
Health  Departments 
treat  me: 


Msla  State 
H.D.   H.D. 


fairly 83^. ..62^ 

courteously 100^. .  .86% 

promptly 53%..  .1^% 

efficiently 70%. ..27% 

professionally 83%. .  .67% 

knowledgeably 57%. .  .76% 

consistently 77%. .  .'»8% 

Respondents  see  the  benefits  from  the  Missoula  City-County  Health  Department 
reviewing  certificates  of  survey  instead  of  the  State  as:  (1)  timeliness, 
(2)  knowledge  of  local  area  and  conditions,  (3)  efficiency  (less  duplication 
of  services),  and  (4)  a  better  review. 

Many  respondents  foresaw  no  negative  aspects,  but  those  who  had  comments  were 
concerned  with  the  uniformity  of  c.o.s.  review  across  the  State,  the  need  for 
an  appeal  process  (if  the  local  health  department  were  to  take  on  c.o.s.  review). 
(Questions  #4) 

Compared  to  other  reviewing  agencies,  the  local  health  department  is  seen  as 
easy  to  deal  with,  contrasted  with  responses  which  show  the  State  Health 
Department  as  difficult  to  deal  with.  (Question  #5) 

Respondents  overwhelmingly  (79%)  felt  the  existing  subdivision  requirements 
are  effective  in  protecting  the  ground  water  (Question  #6).  They  feel  the 
Missoula  Health  Department  effectively  enforces  existing  subdivision  regulations 
(93%)  (Question  #7).  Compared  to  five  years  ago,  respondents  thought  the 
Missoula  Health  Department  had  improved  its  general  subdivision  review  process 
(62%)  or  stayed  the  same  (28%).  Ten  percent  thought  the  Health  Department  had 
gotten  worse  in  its  general  subdivision  review  process.  (Question  #8) 

About  50%  of  the  respondents  felt  that  there  was  nothing  unclear  or  confusing 
about  the  c.o.s.  or  subdivision  review  process.  Those  who  felt  the  process 
was  unclear/confusing  generally  mentioned  exemptions  (rights  of  way,  occasional 
sales,  gifts  to  family  members,  etc.),  changes  in  interpretation  of  rules 
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(and  "statute  not  well -written"),  and  differences  in  different  counties' 
enforcement  and  interpretation.  (Question  #9) 

More  respondents  (69%)  felt  that  there  weren't  too  many  changes  in  subdivision 
regulations  from  one  time  to  another.  Of  those  who  said  there  were,  many  did 
agree  that  the  changes  were  necessary,  although  some  mentioned  insufficient 
public  notice,  inconsistent  interpretation  and  others  mentioned  circumvention 
of  the  laws.  (Question  #10) 

The  local  health  department  is  seen  as  relatively  easy  to  deal  with  during 
the  subdivision  review  process  and  the  State  Health  Department  is  seen  as  among 
the  worst  to  deal  with.   (Question  #11) 

One-half  of  the  respondents  said  at  one  time  or  another,  they'd  had  problems 
with  the  local  health  department  that  were  not  resolved  to  their  satisfaction. 
Problems  generally  centered  around  (1)  health  department  being  too  arbitrary 
or  rigid,  (2)  time  delays  that  increased  costs  to  the  respondents  (or  their 
clients),  (3)  differences  in  interpretation  of  statutes,  and  (4)  problems  with 
septic  tank/drainfield  construction  or  location. 

One-half  of  the  respondents  admitted  unresolved  differences  with  the  State 
Health  Department.  Their  problems  centered  around  (1)  incomplete  reviews 
(where  the  submittal  was  "returned  at  the  end  of  the  legal  limit  for  one  or 
two  errors  and  then  the  corrected  submittal  was  returned  again  later  for  one 
or  two  new  errors."),  (2)  unwillingness  to  work  with  submitter,  and  (3)  not 
understanding  that  time  delays  and  regulations  by  the  health  department  were 
costly  to  the  respondent.  (Question  #12) 

Respondents  overwhelmingly  felt  the  Missoula  staff  members  were  good  to  work 
with.  The  few  negative  comments  centered  around  respondents  feeling  that  in 
some  situations,  Missoula  Health  Department  personnel  were  inflexible  and 
unwilling  to  work  out  problems.  (Question  #13) 

General  suggestions  and  comments  centered  around  seven  categories: 

t  "Both  health  departments  need  to  do  more  public  relations 

and  get  out  more  information  to  both  the  public  and  subdivision 
professionals,  perhaps  through  use  of  a  newsletter,  informational 
seminars,  guides  for  going  through  the  steps  of  a  submittal, 
and  notification  of  changes  in  the  laws  or  interpretation." 

•  "More  inter-agency  cooperation,  to  ease  the  hassles  with 
following  a  submittal  through  channels." 

•  "Correcting  situations  where  a  submittal  is  returned  for  one 
or  two  errors,  correction  is  made  and  then  the  State  finds 
more  errors  on  the  corrected  submittal  —  usually  at  the  end 
of  the  legally  alloted  time  period." 

•  "Be  more  consistent,  i.e.,  enforcing  regulations  and  dealing 
with  individuals. " 

t  "Shorten  length  of  time  needed  for  submittals  and  be  more 
aware  of  economic  costs  of  hold-ups." 
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•  "Return  phone  calls  quicker  from  Missoula  Health  Department." 

•  "Be  more  flexible  and  willing  to  work  out  differences,  and 
to  help  submittor  with  problems." 

(Question  #14) 

In  general,  respondents  felt  good  about  the  local  health  department's 
personnel,  procedures  and  attitudes,  but  were  markedly  less  positive  about 
the  State  Health  Department,  {it  should  be  noted  that  the  State  Health  Department 
is  move  of  a  regulatory  body  than  the  local  health  departments,   and  respondents 
are  also  more  able  to  walk  into  the  looal  health  departments  and  work  out 
problems.     It  is  more  difficult  to  travel  to  Eelena  to  do  the  same,   although 
many  respondents  said  that  they  had  gone  to  Helena  at  one  time  or  another  to 
meet  and  try  to  establish  a  working  relationship  with  the  State  personnel.  ) 

Respondents  were  uniformly  pleased  that  someone  came  into  their  office  and 
asked  them  for  their  opinions.  Several  mentioned  their  approval  of  the  survey 
and  about  one-quarter  asked  for  a  results  report.  (An  abbreviated  version  of 
this  report  will  be  mailed  to  each  respondent  in  response  to  this  request.) 
Inevitably,  a  study  like  this  generates  a  good  deal  of  good  will  and  positive 
public  relations  for  the  agency.  Respondents  like  the  idea  that  the  departments 
care  enough  to  send  someone  in  to  talk  to  them  and  get  their  opinions. 

Respondents'  wishes  for  confidentiality  were  carefully  honored.  Only  responses 
supported  by  other  similar  answers  are  included  in  the  tabulations  and  in  this 
report.  Responses  did  fall  neatly  into  patterns  and  were  easily  cross-correlated, 
showing  strong  internal  validity  of  the  study. 


CONCLUSIONS 

The  Missoula  Subdivision  Survey  was  a  solid  success.  A  good  deal  of  data 
has  been  presented,  much  of  which  is  positive,  but  much  indicating  changes 
could  be  made  for  the  better.  Areas  for  particular  attention  for  the  Missoula 
Health  Department  are: 

•  conduct  more  public  relations  and  information;  interact  more 
with  subdivision  professionals;  and  show  more  understanding 
of  their  problems,  both  economic  and  time. 

•  improve  the  management  of  submittals  (time  and  error  reports). 

•  be  seen  as  more  flexible  and  willing  to  work  out  problems  with 
the  submittor,  and  provide  more  clear,  complete  information. 

According  to  the  survey,  the  State  Health  Department's  weak  areas  are: 

•  speed  and  efficiency  of  submittal  routing  and  actions,  and 
improvement  of  repeated  submittal  returns  near  the  end  of  the 
legal  limitations. 
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•  improve  image  by  being  perceived  as  more  flexible  and  less 
overbearing. 

The  survey  accomplished  its  purpose  of  showing  how  people  view  the  local 
and  State  health  departments,  as  well  as  creating  much  good  will  toward 
agencies  who  care  enough  to  ask  for  direct  feedback  on  their  actions  and 
operations.  I  enjoyed  my  part  in  presenting  this  information  to  you. 

j: 


Janice  S.  Hand 
Research  Specialist 
Community  Health  Services 

Evaluation  and  Planning  Project 
Missoula  City-County  Health  Dept. 
October  1980 
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T'  SECTION  4 

TO  MEASURE  PROGRAM  EFFICIENCY  AND 
ACCURACY  ~  AN  ACTION  LOG 

Results  -  Errors  or  omissions  on  subdivision  submittals  were  most  generally  made 
by  the  submittor  (consultant)  (91^),  discovered  by  the  local  health  department 
(70^),  and  were  the  fault  of  the  consultant  (^2^).   (See  page  h.h    for  report.) 
These  results  were  compiled  by  reviewing  Missoula's  Action  Logs  and  a  sample  of 
submittal  folders. 

Discussion  -  The  results  showed  that  the  Missoula  Health  Department  was  indeed 
meeting  its  goal  of  taking  first  action  on  submittals  within  10  days.   The  low 
percentages  of  local  health  department  error  are  also  positive  program  feedback, 
while  the  high  percentage  of  consultant  error  (91^)  indicates  some  education  is 
needed.   Special  training  and  discussion  of  problems  was  held  with  sanitarians 
as  a  result  of  the  evaluation. 

The  Missoula  Health  Department  chose  to  conduct  a  three  month  sampling. 
Sanitarians  carefully  completed  the  Action  Log  for  three  months  instead  of  throughout 
the  year,  which  gave  a  good  approximation  of  actual  time  spent  on  submittals. 
Average  sanitation,  engineering,  and  clerical  time  is  then  extrapolated  to  the  whole 
year  by  multiplying  average  staff  time  by  the  number  of  submittals. 

)' ■  The  other  (more  accurate)  method  is  to  complete  Action  Logs  on  each  submittal 

and  use  actual,  rather  than  estimated  information. 

Methodology  -  The  Action  Log  is  designed  to  be  attached  to  the  left  inside  cover 
of  a  submittal  file  folder.   All  personnel  time  and  mileage  used  for  the  submittal 
should  be  recorded  in  at  least  15  minute  (1/A  hour)  increments.   You  may  want  to 
analyze  the  data  on  a  quarterly,  semi-annual,  or  annual  basis. 

This  evaluation  calls  for  analyzing  the  logs  for  three  pieces  of  data:   (l)  com- 
pliance with  internal  department  objectives  of  reviewing  each  submittal  within 
X   days  (10  days  is  Missoula's  objective);  (2)  errors  and  omissions  and  by  whom,  and 
(3)  average  per  actual  personnel  time  per  activity  per  submittal  (for  cost 
analysis  -  see  Section  2).   The  analysis  is  probably  best  done  by  a  program 
administrator  or  supervising  sanitarian. 
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Rate 

Cost 
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MISSOULA  CITY- COUNTY 
HEALTH  DEPARTMENT 

301  West  Alder   •    Missoula.  Montana  59801    •    Ph.(406)721-5700 


December  23,  198l 


TO:  Joe  Aldegarie 

Environmental  Healtt 


FROM:  Janice  S.  Ha 
Research  Spec 


Director 


Subdivision  Review  Program  Evaluation  Report 


Here  is  an  analysis  of  errors  or  omissions  made  on  subdivision  submittals  and 
average  time  to  first  action.   This  information  is  part  of  the  Subdivision 
Review  Program  Evaluation.   Cliff  Foy,  Senior  Sanitarian,  reviewed  a  sample  of 
submittal  folders  in  October  and  provided  the  information.   I  analyzed  his  results, 


Errors  or  Omissions 

Made  by:    Consultant  9U 

Local  Health  Dept.  3% 

Neither  6% 


100% 

Found  by: 

Local  Health  Dept. 

70% 

State  Health  Dept. 

27% 

Local  and  State 

3% 
100% 

Fault  of: 

Consultant 

k2% 

Local  Health  Dept. 

^^% 

State  Health  Dept. 

0 

None 

3h% 

Local  and  State 

10% 

fooT 


A  sample  of  52  records  were  reviewed;  30  had  some  sort  of  error  or  omission, 
ranging  from  further  information  needed  to  sloppy  submittal. 

Time  to  First  Action 


The  average  time  to  action  is  8  days,  while  the  mode  (or  most  frequently  mentioned) 
is  10  days  and  the  median  (middle)  is  7  days.   These  statistics  show  that  your  goal 
of  first  action  within  10  days  is  generally  being  met.   Twenty  percent  of  records 
were  not  reviewed  within  the  10  day  limit.   Thirty-three  percent  showed  first  action 
in  5  days  or  less.   (^9  records  were  reviewed.) 


JSH/j  revised 
cc:  CI  iff  Foy 
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MAKING  A  DIFFERENCE 


SUBDIVISION  REVIEW  MODEL 
Evaluation  Plan 


The  first  subdivision  law  for  Montana  was  enacted  by  the  legislature  in  1895. 
The  statute  not  only  required  plats  and  surveys  to  be  recorded,  but  also  spelled 
out  the  requirements  for  plats,  surveys,  certificates  of  survey,  certificates  of 
dedication  and  abstracts  of  title. 

Although  Montana  subdivision  laws  have  changed  many  times  since  the  original 

in  1895,  the  prime  concern  of  government  still  centers  on  the  public  health 

aspects  of  water  quality  and  potability,  sewage  treatment  and  disposal,  and 

solid  waste  management.  In  1973,  the  legislature  enacted  HB  465  which  served  to 

change  previous  subdivision  history  -- 

...  no  map  or  plat  may  be  filed,   no  building  may  be 
erected  or  oaoupied,   and  no  lot  may  be  sold  until 
the   local  health  officer  has  approved  water 
availability  and  quality  and  sanitary  facilities 
and  the  state  department  has  indicated  the  subdivision 
is  not  subject   to  sanitary  restriction.  ^ 

Local  health  departments  currently  have  the  authority  to  review 
certificates  of  survey  and  minor  subdivisions  for  conformance  to  laws  and  State 
Health  Department  regulations  and  for  granting  local  approval  to  major  subdivisions. 

Recognizing  the  benefits  of  evaluating  both  process  and  effectiveness  of  the 
subdivision  review  program,  a  State-Local  Evaluation  Committee  was  formed  in  1977. 
The  Committee,  comprised  of  members  from  local  health  departments  as  well  as  the 
State  Health  Department,  established  a  Subdivision  Subcommittee  whose  goal  was  "to 
recommend  to  the  Evaluation  Committee  a  workable  means  to  evaluate  subdivision 
programs  that  are  conducted  by  the  state  and  local  health  departments." 

The  work  started  by  the  Committee  was  formalized  by  the  approval  of  a  two  year 
research  and  evaluation  grant  project  between  the  Montana  Department  of  Health 
and  Environmental  Sciences  and  the  Missoula  City-County  Health  Department, 
contractor  for  the  project.  The  Missoula  Health  Department,  responsible  for 

iMontana  Legislative  Council,  "Montana  Subdivision  Laws:  Problems  and 
Prospects,"  November  1978,  p.  9. 
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developing  evaluation  model sforeight  public  health  programs,  will  develop  and 
test  evaluation  models  in  Missoula,  revise  them  as  necessary  and  then  distribute 
"user  guides"  to  local  and  state  health  departments  for  use  in  their  evaluations. 
The  Subdivision  Evaluation  Model  will  be  designed  so  that  health  departments may 
take  all  or  parts  of  it  for  use  in  evaluation  and  quality  assurance  of  their 
programs. 

Literature  Search 

A  literature  search  revealed  no  availableworks  on  evaluation  of  subdivision 
review  programs.  Because  of  that  unsucessful  search  and  because  the  process  of 
review  is  largely  a  matter  of  specific  regulations  and  laws,  input  from  those 
working  in  that  field  was  particularly  valuable: 

-  Ed  Casne,  Bureau  Chief,  Subdivision  Bureau,  Montana  Department 
of  Health  and  Environmental  Sciences,  Helena,  Montana 

-  Joe  Aldegarie,  Director  of  Environmental  Health,  David  Feffer, 
Health  Officer,  Missoula  City-County  Health  Department,  Missoula, 
Montana 

-  Tom  Cowan,  Environmental  Health,  Bruce  Mclntyre,  Health  Officer, 
Flathead  City-County  Health  Department,  Kalispell,  Montana 

-  Jim  Neely,  Environmental  Health  Director,  George  Sheckleton, 
Health  Officer,  Yellowstone  Health  Department,  Billings,  Montana 

-  Will  Selser,  Environmental  Health  Director,  Bob  Johnson,  Health 
Officer,  Lewis  and  Clark  Health  Department,  Helena,  Montana 

-  Pete  Frazier,  Environmental  Health  Director,  Don  Pizzini,  Health 
Officer,  Cascade  City-County  Health  Department,  Great  Falls,  Montana 

-  Emery  Nelson,  San-itation  Division,  Edward  King,  Health  Officer, 
Gallatin  City-County  Health  Department,  Bozeman,  Montana 

-  Bill  Burke,  Butte-Silver  Bow  Health  Department,  Butte,  Montana 

-  Dave  Thomas,  Resource  Development  Specialist,  Health  Planning  and 
Resource  Development  Bureau,  Montana  Department  of  Health  and 
Environmental  Sciences,  Helena,  Montana 

Method  of  Procedure 

Because  of  concern  with  both  outcome  (sewer  ftn'lures), 
and  process  (time  limits  for  processing  subdivision  review,  etc.),  evaluation 
objectives  for  each  have  been  established.  Objectives  are  designed  to  provide 
specific  measures  of  the  program's  effectiveness  and  efficiency  so  that  meeting 
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each  objective  becomes  a  measure  of  the  program's  success  in  meeting  its  over- 
riding goal  --  Protect  water  quality  and  insure  effective  sewage  treatment  and 
disposal  so  that  the  public  is  adequately  protected  against  health  hazards. 
Each  objective  and  its  evaluation  procedure  can  be  easily  modified  to  fit 
individual  health  department  data  needs.  For  example,  the  time  in  Objective 
Four  can  be  changed  to  realistically  reflect  staffing  and  workload.  Each 
evaluation  description  will  follow  the  same  format:  (1)  rationale  for  the 
objective  will  be  discussed,  (2)  methodology  will  be  detailed  and  explained,  and 
(3)  use  of  data  by  administrators  will  be  suggested. 

Objectives* 

1.  TO  RECEIVE  BACK  FROM  THE  STATE  HEALTH  DEPARTMENT  NO  MORE  THAN 
5%  OF  SUBMITTED  CERTIFICATES  OF  SUBDIVISION  PLAN  APPROVAL  FOR 
BEING  IN  ERROR  OR  INCOMPLETE. 

2.  TO  INSURE  THAT  THE  NUMBER  OF  DWELLING  UNITS  EXPERIENCING  SEWER  FAILURES 
DOES  NOT  EXCEED  5%  PER  YEAR  OF  THE  TOTAL  NUMBER  OF  DWELLING  UNITS  APPROVED. 

3.  TO  MAINTAIN  ACCURATE  RECORDS  OF  ALL  SUBDIVISION  AND  CERTIFICATE 
OF  SURVEY  SUBMITTALS  AND  ACTION  TAKEN. 

4.  TO  TAKE  NO  MORE  THAN  10   WORKING  DAYS  BEFORE  FIRST  ACTION  IS  TAKEN 
ON  CERTIFICATES  OF  SURVEY  AT  THE  LOCAL  LEVEL  AND  10   WORKING  DAYS 
AT  THE  STATE  LEVEL. 

5.  TO  DETERMINE  ENGINEERING  FIRMS',  LAND  DEVELOPERS',  AND  OTHER 
AGENCIES'  PERCEPTIONS  OF  THE  HEALTH  DEPARTMENT'S  EFFECTIVENESS 
AND  COMMUNICATIONS. 

6.  TO  ACCURATELY  TRACK  COSTS  OF  CONDUCTING  THE  CERTIFICATE  OF  SURVEY 
AND  MINOR  SUBDIVISION  PROGRAM. 

Objective  1  To  receive  back  from  the  State  Health  Department  no  more  than 

5%  of  submitted  certificates  of  subdivision  plan  approval  for 

being  in  error  or  incomplete. 

Rationale  -  Extra  staff  and  transit  time  is  inevitable  when  an  erroneous 

certificate  must  be  returned  to  the  originating  health  department  from  the 

State.  A  measurable  objective  will  insure  that  problems  are  traced  and 


Percentages  and  numbers  of  days  In  italics  may  be  changed  for  each  department. 
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will  provide  data  from  which  improvements  may  be  made  as  necessary. 

Methodology  -  Use  of  a  simple  time  log  attached  to  the  front  of  each 
certificate's  file  folder  will  provide  data  quickly  and  simply.  The  log  will 
list  each  action  taken  on  the  file,  by  whom,  date  of  action,  (mileage),  and 
cost  (see  also  Objectives  Three,  Four  and  Six). 


TIME  LOG 
Project  ID 
date   initials     action      miles   time  rate  cost 

^^--^-__ 

x 

y 

\ 

Each  staff  member  who  deals  with  the  certificate  will  be  responsible  for 
noting  the  date,  their  initials,  what  action  they  took  and  how  much  time  was 
spent  per  activity  (in  15  minute  intervals  or  other  time  increments  as  desired).     > 

Use  of  Data  -  Each  quarter  (or  as  needed),  a  report  can  be  made  so  that 
administrators  can  track  the  number  of  certificates  of  subdivision  plan  approval 
returned  for  being  in  error  or  incomplete.  Should  significant  numbers  or  an 
amount  greater  than  5%  be  returned,  then  administrators  have  the  necessary 
information  to  correct  the  problems  by  holding  staff  inservice  training, 
providing  written  guidelines,  etc. 

Objective  2  To  insure  that  the  number  of  dwelling  units  experiencing  sewer  failures 

does  not  exceed  5%  per  year  of  the  total  number  of  dwelling  units  approved. 

Rationale  -  Since  the  reason  for  doing  subdivision  review  is  to  insure  adequate 
sewage  treatment,  a  firm  measure  of  effectiveness  has  been  deemed  essential  by 
program  managers.  Although  there  is  no  standard  for  the  length  of  time  a  sewer 
system  "should"  last,  failures  are  generally  evident  to  trained  sanitarians, 
whether  they  are  from  inadequate  maintenance,  poor  design  or  faulty  installation. 

Methodology  -  A  form  currently  distributed  by  the  State  Health  Department, 
Subdivision  Bureau,  is  designed  to  track  all  failures  per  county.  For  purposes 
of  this  evaluation,  the  State  form  will  be  simplified  to  enable  sanitarians  to      v 
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fill  it  out  quickly  and  easily.  (See  Appendix  A  for  existing  form.)  When 
completed,  one  copy  should  be  retained  by  the  local  health  department  and  one 
copy  should  be  made  and  sent  to  the  Subdivision  Bureau. 

The  concept  of  "dwelling  unit"  will  be  used  in  order  to  differentiate  between 
possible  consequences  of  a  failure  of  a  system  serving  one  family  and  the 
failure  of  a  system  serving  30  families.  For  purposes  of  this  evaluation, 
"dwelling  unit"  will  mean  individual  housing  for  a  family  or  people  living  together 
(i.e.,  each  will  include  at  least  a  kitchen,  bathroom  and  living  area). 

Because  the  average  sewage  system  is  designed  to  last  approximately  20 
years,  common  causes  of  failure  will  be  listed  for  the  reviewing  sanitarian 
who  must  also  use  professional  judgement  for  those  he/she  determines  have  failed 
before  they  should  have. 

Use  of  Data  -  Given  data  on  causes  of  sewer  failure,  it  will  become  a  good 
deal  easier  for  sanitarians  to  be  alert  for  common  problems  such  as  failures 
located  in  a  common  area,  installers  who  have  an  inordinately  high  rate  of 
sewer  system  failures  before  the  20-25  year  expected  life,  etc.  Additionally, 
as  a  measure  of  sanitarian  effectiveness,  the  data  will  be  able  to  track  the 
type  of  problems  that  appear  and  give  an  indication  of  avoidable  problems. 

Objective  3  To  maintain  accurate  record  of  all  subdivision  and  certificate 
of  survey  submittals  and  action  taken. 

Rationale  -  As  a  process  measurement  of  public  health's  efficiency,  good 
records  are  important  to  track  time  from  initiation  to  approval,  action  taken 
and  problems  discovered.  Data  from  a  tracking  system  not  only  is  useful  as  a 
count  of  "how  many"  and  "what  happened?,"  but  also  as  a  measure  of  time 
limitations. 

Methodology  -  The  time  log  mentioned  in  Objective  One  will  also  serve  to 
accurately  track  subdivision  and  certificate  of  survey  submittals  as  well  as 
the  processes  that  occur  between  submittal  and  approval. 

One  sanitarian  should  be  assigned  the  responsibility  of  reviewing  the  time 
logs  to  insure  that  they  are  being  filled  out  completely.  Spot  checks  should 
be  made  throughout  the  year  to  insure  that  records  are  being  kept  completely 
and  accurately  by  both  State  and  local  personnel. 

Use  of  Data  -  Since  time  logs  are  easily  completed  and  attached  to  file 
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folders,  the  process  should  be  easy  to  comply  with.  Complete  records  will 
provide  answers  to  questions  about  "what  was  done?"  and  "when  did  action  x 
occur?"  as  well  as  compliance  with  legal  time  constraints  (see  Objective  Four). 

Objective  4  To  take  no  more  than  10   working  days  before  first  action  is  taken 
on  certificates  of  survey  at  the  local  level  and  10   working  days 
at  the  State  level. 

Rationale  -  This  objective  was  established  as  a  measure  of  efficiency  for  the 
certificate  of  survey  program.  The  number  of  days  should  be  considered  variable 
and  should  depend  on  the  individual  department's  workload  and  staffing.  Because 
legal  requirements  call  for  action  to  be  taken  on  certificates  of  survey  within 
50  days,  local  health  departments  must  act  at  least  within  that  limit  and  the 
State  must  act  at  least  within  10  days. 

Methodology  -  Through  use  of  the  record  form  discussed  in  Objectives  One  and 
Three,  a  simple  measure  of  number  of  days  can  be  made  and  tallied  for  inclusion 
in  monthly,  quarterly  or  yearly  reports  by  the  sanitarian  in  charge.  If  actions 
take  longer  than  the  objective  states,  then  careful  records  should  be  kept  in 
order  to  determine  whether  actions  are  indidual  special  cases  or,  indeed,  if 
the  problems  are  consistent  and  require  action.  (Action  =  Approval  or  Disapproval.) 

Use  of  Data  -  As  a  check  of  whether  or  not  the  10  day  objective  is  being  met, 
this  system  will  yield  data  that  is  quickly  gathered  and  analyzed.  If  the  data 
shows  the  objective  to  be  unmet,  then  administrators  can  determine  why  (workload 
too  heavy?  staff  untrained?  etc.)  and  make  appropriate  changes. 

Objective  5  To  determine  engineering  firms',  land  developers',  and  other 

agencies'  perceptions  of  the  health  department's  effectiveness 

and  communications. 

Rationale  -  Public  health  has  never  tried  to  measure  its  impact  on  those 

companies  and  groups  it  works  with.  This  survey  would  break  that  barrier  by 

personal,  confidential  interviews  with  engineering  firms,  land  developers  and 

other  agencies  who  deal  with  the  health  department  on  subdivisions,  sewer 

permits  and  certificates  of  survey. 

Methodology  -  The  survey  will  be  designed  to  gather  data  on: 

•  perceptions  of  health  department's  efficiency 
and  effectiveness 


•  clarity  of  health  department  instructions 
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•  satisfaction  with  working  relationship  with  health  department 

•  suggestions  for  improvement  of  health  department's  relationships 
A  15-20  minute  personal  interview  to  be  conducted  by  research  staff  for 

Missoula  can  also  be  conducted  by  trained  secretarial  staffs  of  other  departments. 
The  interview  will  be  with  a  sample  of  land  developers  as  well  as  each 
engineering  firm  and  agency  (Planning  Board,  Surveyor's  Office,  etc.)  the 
health  department  deals  with.  The  survey  must  be  strictly  confidential  and 
individual  replies  will  not  be  released  in  order  to  insure  frank  responses. 

Time  sheets  will  be  kept  and   the  cost  of  conducting  the  survey  will  be 
included  in  the  results  report. 

Use  of  Data  -  Any  problems  and  communication  gaps  revealed  by  the  survey  can 
be  corrected,  with  the  chance  of  improving  working  relationships  and 
the  health  department's  image.  (Interestingly,  a  side-effect  often  seen  in 
the  aftermath  of  surveys  is  an  increase  in  department  image  because  "Someone 
from  the  health  deppirtment  was  here  and  wanted  to  know  what  I  thought!") 

Objective  6  To  accurately  track  costs  of  conducting  the  certificate  of  survey 
and  minor  subdivision  program. 

Rationale  -  As  with  most  other  parts  of  the  Community  Health  Services  Evaluation 
Project,  evaluation  cost  data  is  listed  by  administrators  as  a  prime  priority. 
Because  many  agencies  are  caught  between  legal  and  professional  obligations 
and  money  and  staff  limitations  of  conducting  the  inyriad  of  public  health 
programs  today,  it  has  become  more  and  more  imperative  to  have  accurate  cost 
information. 

Methodology  -  Minor  subdivision  and  certificate  of  survey  time  data  will  be 
kept  by  sanitarians  and  State  personnel  in  the  time  log  (as  mentioned  in 
Objectives  One,  Three  and  Four).  The  log  has  space  for  computing  costs  per 
each  action  by  the  personnel  involved.  Costs  per  each  certificate  of  survey 
and  minor  subdivision  can  be  tabulated  individually  or  total  costs  can  be 
compiled  as  needed.  A  cost  worksheet  will  be  included. 

Because  it  is  difficult  to  separate  subdivision  activities  from  the  daily 
duties  of  a  sanitarian  who  may  do  licensed  food  establishment  inspections, 
sewer  inspections,  water  analysis  and  subdivision  review  as  well  as  investigate 
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garbage  complaints  and  junk  vehicle  problems  all  in  one  day,  a  percentage 
figure  will  be  used  to  estimate  mileage. 

subdivision  salaries  estimated 

^  total  salaries  ^   ^    ^'^^^^  '"^^^^^^  =  subdivision 

'   -'■  (env.   hlth.)  '"^^^^^^ 

A  space  for  mileage  will  be  included  on  the  Time  Log  for  a  cross-check  of 
the  percentage  method  above. 

Use  of  Data  -  Cost  data  is  required  by  administrators  as  a  means  of  determining 
the  allocation  of  resources  and  budgeting  as  well  as  a  program  planning  tool. 

Implication  of  Subdivision  Review  Model 

As  stated  earlier,  the  Subdivision  Review  Model  can  be  generalized  to  fit 
other  health  departments'  needs.  The  methodologies  noted  for  each  objective 
are  clearly  laid  out  and  administrators  can  choose  the  level  of  data  they 
require,  whether  it  be  general  or  specific. 

Measurements  are  given  for  meeting  each  of  the  six  objectives.  These,  too, 
may  be  tailored  to  fit  a  particular  department's  needs.  Missoula's  final 
evaluation  data  will  be  made  available  to  any  administrator  who  would  like  to 
use  it. 

It  is  important  for  most  of  the  evaluation  to  be  continued  from  year  to  year 
(or  quarterly,  etc.)  as  a  time  series  so  that  trends  and  baselines  may  be 
established  and  then  measured  over  time.  As  staff  become  familiar  with  the 
procedures,  this  will  become  a  quick  and  easy  process. 

Publication  of  the  methodology  and  results  of  this  evaluation  model  should 
be  considered.  Judging  from  an  unsuccessful  literature  search,  little  has  been 
accomplished  in  the  evaluation  of  subdivision  review  programs  nation-wide.  This 
project  is  a  first  and  publishing  its  results  would  surely  contribute  to  the 
state-of-the-art. 


J.S.  Handj; 
March  1980 
MCCHD,  Missoula 
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MONTANA  DEPARTMENT  OF  HEALTH 
AND  ENVIRONMENTAL  SCIENCES 


SEWAGE  TREATMENT  SYSTEM  FAILURE  SURVEY 


N.imc  oC  Owner 


I..K.1I  I  (111  County 

Date  Installed Section,  Township,  Range_ 

Name  of  instal Icr 


I'yjio  of  System  (Please  specify  size  of  tank,  amount  of  drainfield,  etc.  and  include 
drawing  if  possible) 

Septic  tank  drainfield 

i:vai)otranspi  ration 

Seepage  l'it_^ __________^ 

Other 


Soil  Description  (Please  provide  a  general  description  of  soils  in  the  drainfield  area.  If 
information  is  available,  please  describe  to  a  depth  of  6  feet,  including 
any  impervious  layers.) 


Has  this  area  ever  been  flooded  or  inundated?  Yes_ 
1 r  so,  when? 


What  is  the  minimum  depth  to  groundwater  at  the  drainfield  site? 
Depth  of  drainfield  below  ground  level 


System  located  in:   Fill  material Native  material 

.' a^son^  *ilL  I '''  ^'Te 

1)  High  w.iter  table 4)    Under  design  6)     Other 

2)  Impervious   soils .S)   Construction  ___________ 

5)      Steep  slopes      


Typo  of  Waste  Discharged  Into  System 

Domestic    (household) Other    (please   describe)_ 


Description  of  Failure 


Other  Comments 


orni  Completed   tiy: 
V78    DHES  /Sub    ffl 
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INTRODUCTION 

Explanation  of  Evaluation  Project  -  This  Users'  Guide  demonstrates  four  ways  to 
evaluate  your  Licensed  Food  Establishment  Program  —  from  a  computer  program 
which  stores  and  analyzes  inspection  data  to  a  cost  analysis  of  the  program. 
The  evaluation  is  a  result  of  the  two-year  Community  Health  Services  Evaluation 
and  Planning  Project,  conducted  from  1979  to  I98I  by  the  Missoula  City-County 
Health  Department. 

The  evaluation  project's  goal  is  to  provide  practical,  efficient  evaluation 
methods  that  public  health  administrators  can  use  when  evaluating  their  own 
programs. 

Scope  of  Licensed  Food  Establishment  Program  Evaluation  -  Because  restaurant 
inspections  take  more  staff  time  than  inspections  of  groceries,  meat  markets, 
bakeries,  bottlers,  hotels,  motels,  and  trailer  courts,  this  evaluation  is 
designed  for  foodservice  inspections  only.   Evaluation  procedures  shown  in  this 
Guide  can  be  easily  expanded,  following  the  same  procedures  shown  for  foodservice 
evaiuat  ion. 

Each  evaluation  methodology  is  designed  to  smoothly  fit  into  your  health 
department's  existing  program  and  to  produce  clear  and  immediately  usable  data. 
Because  the  Missoula  Health  Department  was  the  test  site  for  this  evaluation 
model,  the  examples  shown  in  this  Guide  are  based  on  Missoula's  program  and 
data.   You  may  need  to  modify  some  parts  of  the  evaluation  to  fit  your  program's 
features  or  expand  the  evaluation  to  other  inspection  programs. 

Each  section  of  the  Guide  shows  Missoula's  results,  discusses  evaluation  pro- 
cedures, reviews  evaluation  models  and  provides  forms  used  to  collect  data.   The 
Cost  Analysis  Worksheets  and  protocol  are  copy-ready. 

Changes  from  Original  Evaluation  Plan  -  An  evaluation  plan  is  simply  a  brief 
outline  of  proposed  work.   When  parts  of  the  original  Licensed  Food  Establishment 
Evaluation  Plan  proved  infeasible,  they  were  revised. 

1.  Objective  3,  Sanitarian  To  Keep  Inspection  Form  Until  A-  and  5-Point 
Violations  Are  Corrected  —  Changed.   This  procedure  is  generally 
efficient,  but  the  Missoula  Health  Department  enters  the  information 
into  the  SPIF  computer  system  and  uses  SPiF  reports  to  track 
correction  of  k-   and  5-point  items. 

2.  Objective  'i.  Sanitation  Standards  —  Changed.   The  Licensed  Food.  Establish- 
ment Inspection  protocol,  Section  2,  covers  both  standards  and  i^forcement 
procedures. 

3.  Objective  5,  Food-borne  Illness  Incidence  — Completed  and  found  to  be 
infeasible  as  a  separate  effort  from  the  Communicable  Disease  Reporting 


System.   A  survey  of  Missoula  physicians  and  emergency  room  physicians 
shows  that  most  doctors  believe  food-borne  illness  is  uncommon  in 
Missoula.   Most  respondents  said  they  saw  three  or  fewer  cases  per 
month.  Although  we  recognize  that  a  good  outcome  measure  of  the 
Licensed  Food  Establishment  program  would  be  to  track  food-borne 
illness,  there  are  several  important  reasons  why  that  measure  is 
impractical.   First,  a  good  Communicable  Disease  Reporting  System  will 
insure  that  food-borne  illnesses  are  reported  to  the  health  department. 
Second,  a  good  many  cases  of  food-borne  illness  are  never  reported 
to  either  physician  or  health  department,  so  tracking  true  incidence 
is  very  difficult.   Third,  many  times  food -borne  illness  is  diagnosed 
as  gastrointestinal  and  true  incidence  is  hard  to  know. 
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r)  Section  1 

THE  SPIF  COMPUTER  PROGRAM  —  A 
PROCESS  AND  OUTCOME  MEASURE 

Results  -  The  Missoula  Health  Department  is  now  using  the  SPIF  (Sanitation  Program 
Information  Formulator)  computer  program  for  filing  and  analyzing  its  foodservice 
inspection  data.   The  SPIF  system  is  providing  information  to  measure  standardization 
between  sanitarians,  to  compare  individual  sani tarians  '  scoring  with  county 
averages,  to  show  sanitarian  workloads,  and  to  analyze  inspection  data  by  violation, 
by  establishment,  by  type  of  establishment  and  by  sanitarian.   SPIF  Report  2B 
has  replaced  use  of  the  continuous  record,  which  was  kept  manually.   (See  complete 
list  of  reports  on  page  1.3). 

SPIF  reports  show  that  Missoula's  average  establishment  score  is  90,  well  over  the 
level  of  80  that  is  to  trigger  enforcement  action  (See  Protocol,  pages  5-1  "  S.Z'l). 
Analysis  of  SPIF  reports  also  point  out  that  results  of  129  follow-up  inspections 
were  not  documented. 

Another  process  evaluation  is  standardization  of  sanitarians.   SPIF  reports  show 
that  Missoula  sanitarians  are  well  standardized.   There  are  no  significant  differences 
from  one  sanitarian  to  another,  and  reports  demonstrate  that  the  last  standardi- 
zation in  August,  1980  significantly  decreased  sanitarian  scoring  differences. 

W'     Discussion  -  The  SPIF  computer  program  was  developed  by  a  Washington,  DC  consulting 
firm.  Opportunity  Systerrs  incorporated,  in  response  to  the  FDA's  need  for  a  system 
to  catalogue  and  analyze  the  vast  amount  of  data  generated  by  foodservice  inspections. 
The  Missoula  application  was  the  smallest  in  the  nation  to  date  — all  other  SPIF 
installations  are  at  state-v/ide  levels. 

Largely  because  we  had  to  change  the  SPIF  Program  from  an  IBM  to  a  Burroughs 
computer  system,  it  took  nine  months  to  get  the  system  up  and  operational.   Missoula's 
start-up  personnel  costs  were  estimated  at  $6,000.   The  total  yearly  budget  to  run 
SPIF  will  be  approximately  $1,000  (based  on  one  hour  per  week  environmental  health 
aide,  line  charges  for  the  terminal,  plus  department  overhead). 

Methodology  -  Each  establishment  must  have  two  forms  filled  out  and  entered  into 
the  computer  — a  Food  Service  Establishment  Profile  Form  and  an  Inspection  Form. 
The  Profile  Form  (page  1.A)  enters  an  establishment's  name,  address,  type  of  service, 
meal  volume,  water  supply,  sewage,  emd  other  identifying  information.   Information 
from  the  Food  Service  Establishment  Inspection  Report,  the  required  '♦'♦-item 
inspection  (page  1.5),  can  then  be  entered  after  each  inspection,  complaint  or 
fol low-up. 

Reports  can  be  called  up  for  any  time  period,  whether  reports  are  needed  weekly 
or  yearly.   Time  paramters,  such  as  asking  for  reports  based  on  FY  1981  only,  or 
on  several  years,  can  be  varied  according  to  need. 
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Missoula's  SPIF  system  is  avaible  to  other  health  departments  on  an  actual- 
cost  basis.   Other  departments  will  be  able  to  send  their  Profile  and  Inspection 
Forms  to  Missoula,  who  will  then  enter  the  data,  run  requested  reports,  and  mail 
the  completed  information  back  to  the  department. 
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Table 

1 

Table 

2 

2A 

2B 

Table 

3 

Table 

4 

Table 

5 

Table 

6 

SPIF 
Tables  Produced  by  Report  Generator 


Report  Generator  Produces  Table 

1  1.13 

2  2A,2B 

3  3.4 

4  5,6 

5  7,11.12,14 

6  8 

7  9 

8  10.15,16 

9  17 


Establishment  Profile  listing. 

Report  on  previous  inspection  results  for  each  establishment. 

Includes  all   five  types  of  inspections,  with  written  descriptions 

of  violations. 

Includes  only  regular  inspections. 

Historical  data  for  each  establishment. 

Historical  violations  and  inspection  data  for  each  establishment. 

Violation  statistics  and  the  ratio  of  violations  for  each  sanitarian. 

Violation  statistics  and  the  deviation  from  state/county  ratios 

for  each  sanitarian. 
Table  7     -  Scoring  levels  and  workload  (in  terms  of  inspection  types)  for 

each  sanitarian. 
Table  8    -  Establishment  violation  statistics  (showing  pattern  of  violations 

by  category  of  structural,  operational  and  critical  items). 
Table  9  -  Inspections  by  type  of  establishment  by  type  of  inspection. 
Table  10  -  Violation  statistics  by  most  points  lost  for  each  violation. 
Table  11  -  Scoring  levels  and  workload  (in  terms  of  Inspection  type)  for 

each  county. 
Table  12  -  Scoring  and  inspection  distributions  by  weekly  meal  volume. 
Table  13  -  Summary  counts  of  establishments  in  each  county  by  type  of 

service  by  number  of  meals  served  weekly. 
Table  14  -  Scoring  levels  and  inspection  frequencies  by  type  of  service. 
Table  15  -  Violation  statistics  by  type  of  violation. 
Table  16  -  Violation  statistics  by  category  of  violation. 
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Section  2 
inspection  protocol  —  for  consistent^  effective  inspections 

Results  -  Before  the  Licensed  Food  Establishment  Inspection  Protocol  was  developed, 
Missoula  did  not  have  a  formal  inspection  and  enforcement  procedure.  Staff 
sanitarians  thoroughly  reviewed  the  protocol  In  a  training  session  and  are  currently 
following  the  protocol. 

Discussion  -  Protocols  are   one  clear  way  to  insure  program  quality  and  consistency. 
The  Licensed  Food  Establishment  protocol  also  helps  to  avoid  a  major  complaint  of 
the  foodservice  industry  —  Inconsistency  In  the  inspection  program.  The  protocol 
also  helps  insure  standardization  of  enforcement  procedures. 

Methodology  -  The  Inspection  Protocol  was  written  with  input  from  program  admini- 
strators, local  sanitarians.  State  Food  and  Consumer  Safety  personnel,  and  the  local 
county  attorney.  Protocols  should  be  reviewed  and  updated  at  least  yearly  to  be 
sure  they  remain  up-to-date  and  complete. 
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LICENSED  FOOD  ESTABLISHMENT  PROGRAM 
Inspection  Protocol 

Purpose  of  Inspeation  -  To  insure  safe  and  healthy  food  r.upplicG,  kitchen 
faoilities  and  supvoundings  for  all  licensed  food 
establishments  in  the  county. 

Protocol  -  This  protocol  is  divided  into  four  categories  to 

reflect  common  inspection  situations.      The  protocol 
is  written  to  allow  for  inspectors'  professional 
judgment,   although  the  protocol  should  be  recognized 
as  a  tool  to  insure  consistent,   fair,   efficient     and 
effective  treatment  of  licensed  food  establishments . 
The  protocol  stresses  mutual  agreement  between  the 
Licensed  Food  Establishment  management  and  the 
inspecting  sanitarian  because,  when  time  limits  are 
set  by  both,   management  is  more  likely  to  feel 
responsible  for  the  decision  and  to  cooperate  fully. 

I.  LICENSED  FOOD  ESTABLISHMENT  MANAGER  AVAILABLE  DURING  INSPECTION  -  DEFICIENCIES 
LIMITED  (i.e.,    inspection  score  80  or  greater  and  2  or  f^roer  critical  -1- 
or  5-point  items*) 

1.  Sanitarian  will  write  a  short  explanation  of  each  violation  on  the 
inspection  form  to  clarify  problems.  Sanitarian  will  discuss  limited 
deficiencies  with  manager  by  reviewing  inspection  form, 

A.  If  mutual  agreement  can  be  reached  about  time  limits  for  correction, 
sanitarian  lists  limits  on  inspection  form  and  manager  agrees  by 
signing  the  form.  A  letter  is  not  necessary. 

B.  If  mutual  agreement  can  not  be  reached,  then  the  sanitarian  will 
write  a  letter  to  the  licensed  food  establishment  (LFE)  manager 
(within  two  working  days  after  inspection)  listing  deficiencies  and 
time  limits  for  correction  and  re-inspection  date.  Letter  by  first 
class  mail  to  LFE  manager. 

2.  Followup  should  be  conducted  on  all  critical  4-  and  5-point  items  at 
the  end  of  the  agreed  time  limits. 

A.  If  critical  deficiencies  have  been  corrected,  then  sanitarian  will 
note  on  followup  inspection  report  and  file. 

B.  If  critical  deficiencies  have  not  been  corrected,  then  the  sanitarian 
will  send  a  first  class  letter  to  the  LFE  manager,  listing  the  specific 
critical  deficiencies  and  time  limits  for  correction  of  the  violations. 


*Items  #1,3,4,7,11,12,20,27,28,30,31,35,41,  unless,  in  professional  judgment 
of  sanitarian,  followup  is  of  no  value  (i.e.,  smoking  in  kitchen  violation 
in  item  12).  Mark  "no  followup"  clearly  on  inspection  form. 
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1)  If  critical  deficiencies  are  corrected,  the  sanitarian  will  note 
on  followup  inspection  report  and  file. 

2)  If  critical  deficiencies  are  not  corrected,  then  the  sanitarian 
will  send  a  certified  letter  to  the  LFE  manager,  saying  that  the 
specific  critical  deficiencies  are  to  be  corrected  within  five 
calendar  days  or  enforcement  procedures  will  begin,  (If  the 
certified  letter  is  refused  by  the  LFE  manager,  the  sanitarian 
will  hand-deliver  the  letter  with  one  witness  and  will  detail 
the  action  for  the  LFE  file.) 

a)  If  critical  deficiencies  are  then  corrected,  the  sanitarian 
will  note  on  followup  inspection  report  and  file. 

b)  If  all  critical  deficiencies  are  still  not  corrected,  then 
the  sanitarian  will  proceed  to  enforcement  procedures. 

II.  LICENSED  FOOD  ESTABLISHMENT  MANAGER  AVAILABLE  DURING  INSPECTION  -  DEFICIENCIES 
EXTENSIVE  (i.e.y    inspection  score   less   than  80  or  more   than  2  critical  4- 
or  6-point  items) 

1.  Sanitarian  will  write  a  short  explanation  of  each  violation  on  the 

inspection  form  to  clarify  problems.  Sanitarian  will  discuss  extensive 
deficiencies  with  manager  by  reviewing  inspection  form  and  coming  to 
a  mutual  agreement  about  time  limits  acceptable  to  both  parties  for       ^ 
correction  of  deficiencies.  Inspection  form,  clearly  marked  "Letter  to    " 
Follow,"  is  signed  by  manager.  Before  leaving  the  establishment,  the 
sanitarian  should  stress  the  seriousness  of  the  inspection  findings. 
Within  two  working  days  of  inspection,  the  sanitarian  will  send,  via 
first  class  mail,  a  letter  to  the  LFE  manager,  carefully  defining 
deficiencies,  restating  correction  time  limits  and  again  stressing  the 
seriousness  of  the  violations. 

A.  If  mutual  agreement  i^  reached,  then  the  sanitarian  will  conduct 
followup  on  agreed  date. 

B.  If  mutual  agreement  of  time  limitations  and  violation  corrections 
can  not  be  reached,  then  the  sanitarian  will  send  a  certified  letter 
to  the  LFE  manager  defining  the  deficiencies  and  stating  a  time 
limit  for  correction  of  the  items. 

C.  Followup  win  be  conducted  on  all  critical  4-  and  5-point  items  at 
the  end  of  the  time  limits. 

1)  If  the  deficiencies  have  been  corrected,  then  the  sanitarian 
will  note  on  followup  inspection  form  and  file. 

2)  If  deficiencies  have  not  been  corrected,  then  the  sanitarian  will 
send  a  certified  letter  to  the  LFE  manager  stating  that  corrections 
will  be  complete  five  days  after  receipt  of  letter  or  enforcement    l 
proceedings  will  begin.  (If  the  certified  letter  is  refused  by     ' 
the  LFE  manager,  the  sanitarian  shall  hand-deliver  the  letter 

with  one  witness  and  will  detail  that  action  for  the  LFE  file.) 
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Enforcement  Options: 

1.  If  health  hazards  are  significant,  but  do  not  pose  an  immediate  threat 
to  the  public,  a  letter  will  be  sent  to  the  LFE  manager  telling  him/her 
that  the  Health  Department  must  advise  the  local  Board  of  Health  of  the 
situation  and  its  potential  for  future  health  hazards  at  the  next  regular 
meeting  of  the  Board.  If  the  items  are  corrected,  the  agenda  item  for  the 
Board  of  Health  becomes  moot  and  will  be  canceled. 

2.  The  Health  Department  may  refuse  to  validate  LFE  licenses  for  the  new 
year.  See  Appendix  I,  V.  Sloulin  memo:  "Validation  of  Department 
Licenses  by  Local  Health  Authorities." 

3.  If  agreement  on  correction  of  critical  4-  and  5-point  items  cannot  be 
reached,  the  County  Attorney  will  send  the  LFE  manager  a  standard  letter 
within  two  working  days  by  first  class  mail  (Appendix  B)  notifying  him/her 
of  enforcement  procedures  available  and  asking  manager  to  contact  the 
inspecting  sanitarian  immediately. 

A.  If  the  manager  does  contact  the  sanitarian  and  agrees  to  make 
corrections,  then  the  sanitarian  will  follow  protocol  set  for  111,2. 

B.  If  the  manager  does  not  contact  the  inspecting  sanitarian  within 
five  days  after  receipt  of  letter,  the  Health  Department  will  proceed 
to  further  enforcement  action. 

4.  If  the  establishment  is  in  the  City  limits  and  the  LFE  manager  and  inspecting 
sanitarian  cannot  reach  an  agreement  on  correction  of  critical  4-  and  5- 
point  items,  the  sanitarian  will  write  a  letter  outlining  corrective 
measures  and  time  guidelines,  with  a  copy  of  that  letter  to  go  to  the  City 
Attorney.  If  items  are  not  corrected  within  10  days  of  receipt  of 
certified  letter,  a  request  will  be  made  to  the  City  Council  to  revoke 

the  business  license  of  that  LFE. 

A.  If  all  items  are  corrected  within  10  days,  then  the  sanitarian  will 
notify  the  City  Council  and  City  Attorney,  in  writing,  that  there 
is  no  need  for  further  action. 

B.  If  all  items  are  not  corrected  within  10  days,  a  letter  will  be 
written  to  the  City  Attorney  requesting  City  Council  action  on  the 
matter.  Adequate  documentation  and  possibly  photographs  should  be 
prepared  for  the  Council's  weekly  meeting.  The  inspecting  sanitarian 
and  Environmental  Health  Director  should  meet  with  the  City  Attorney 
to  prepare  the  case  material. 

5.  If  critical  items  create  or  could  imminently  create  a  health  hazard  to 
the  public,  the  Health  Officer  and  Board  of  Health  can  order  the 
abatement  of  nuisances  by  court  injunction,  by  contacting  the  County 
Attorney  to  get  an  injunction  from  District  Court  to  close  the  establishment. 
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The  Health  Department  may  request  license  revocation  by  the  State 
Department  of  Health  and  Environmental  Sciences.  The  State  will  need 
the  following  to  begin  revocation. 

A   Complete  file  on  the  establishment  with  at  least  two  inspections 
showing  that  the  LFE  manager  will  not  comply  with  requests. 

B.  Supportive  data  -  photographs,  copies  of  all  correspondence,  etc. 

1)  The  State  Health  Department  may,  after  providing  opportunity  for 
hearing,  revoke  a  license  for  serious  or  repeated  violations  of 
any  of  the  requirements  of  this  rule  or  for  interference  with 
the  State  Department  of  Health  or  other  authorized  persons  in 
the  performance  of  duty, 

2)  Prior  to  revocation,  the  State  Health  Department  will  notify, 
in  writing,  the  holder  of  the  license  or  the  person  in  charge, 
of  specific  reason(s)  for  which  the  license  is  to  be  revoked  and 
that  the  license  will  be  revoked  at  the  end  of  10  days  following 
service  of  such  notice  unless  a  written  request  for  hearing  is 
filed  within  the  10-day  period,  the  revocation  of  the  license 
becomes  final . 

3)  Submission  to  the  State  Health  Department  of  an  acceptable  plan 
of  correction  within  10  days  after  receipt  from  the  Department 
of  written  notice  of  violation  and  execution  of  an  acceptable 
plan  within  the  time  prescribed  in  the  written  notice  of  approval 
of  the  plan  by  the  Department  will  be  a  bar  to  cancellation  ot 
the  license  for  the  violation. 
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STATE  OF  MONTAfM  A 


July     13,    1979 


TO:     All   Sanitarians 

FROM:     Vern  Sloulin,  R.S.,  Chief  €£S 

Food  &  Consuner  Safety  Bureau 

SUBJECT:     Validation  of  Department  licenses  by  local   health  authorities. 


The  1979   legislature  airended  Title  50,   Chapters   50  through  52  to  include  the 
authority  and  administrative  procedures  for  the  vjlidalion  of  dGpartir;ent  licenses 
by  local   health  officers  or  sanitarians,     A  copy  of  Arr,rtided  Title  50,  Chapter  50, 
covering  food  purveyors,    is  attached.     Chapters  51,   Public  Accoiii;iodatioris,  and 
52,  Trailer  Courts,   read  the  same. 

The  following  is  provided  for  your  information  and  guidance  in  applying  the  lav/. 

SCQPF: 

The  amendments  concern  only  the  issue  of  licenses.  They  do  not  change  the 
procedures  for  revocation  or  cancellation  of  licenses  which  have  been  issued. 
Revocation  and  cancellation  remain  a  function  of  the  Department  of  Health  and 
Environirental  Sciences. 

LICENSE  VALIDATION: 

(a)  Licenses  will  be  validated  in  the  local  jurisdiction  where  the  establishment 
is  located  and  not  the  address  of  the  licensee,  if  the  two  are  different. 

(b)  Licenses  for  itinerant  food  service  establishments  will  be  validated  in 
the  jurisdiction  first  contacted  by  the  itinerant  operator. 

(c)  Where  no  health  officer  or  sanitarian  are  available,  licenses  will  be 
validated  by  the  Chief,  Food  and  Consumer  Safety  Bureau,  and  mailed  directly 
to  the  licensee. 

(d)  The  local  health  officer  may  authorize  the  local  sanitarian  to  validate 
licenses  issued  under  Chapters  50-52.  Such  authorization  should  be  noted  in 
the  minutes  of  the  Board  of  Health,  and  a  letter  indicating  the  assignr^'nt  of 
authority  sent  to  the  Food  an  '  Consumer  Safety  Bureau. 

(e)  Unless  other.vise  directed,  licenses  will  be  mailed  to  the  local  sanitarian 
who  is  then  responsible  for  having  them  properly  validated  and  delivered  to 
the  licensee. 
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<:'datej> 


<narae> 
<address> 

Dear  ^salutation>: 

Missoula  City-County  Health  Department  officials  have  informed  this  office 
that  you  are  operating  a  licensed  food  service  at  ^business  address^  ,  in 
violation  of  several  state  sanitary  regulations  contained  in  Section  16-2.14(2)- 
S14215  A.R.M.   I  am  told  that  you  have  not  corrected  those  violations  despite 
the  repeated  requests  from  Health  Department  personnel.   Under  Montana  law. 
Section  50-50-107,  M.C.A.,  the  County  Attorney  has  a  duty  to  prosecute  violations 
of  the  laws  and  regulations  governing  licensed  food  services  establishments. 

This  is  to  advise  you  that  if  you  do  not  contact  the  Health  Department  and  correct 
these  violations  or  reach  a  mutual  agreement  with  the  Health  Department  to  correct 
them  within  five  (5)  days  of  the  date  of  this  letter,  our  office  will  initiate  oi  " 
or  more  of  the  following  procedures : 

(a)  Obtain  an  injunction  ordering  your  business  to  be  closed  until  the  violations 
are  corrected; 

(b)  Request  the  State  Department  of  Health  and  Environmental  Sciences  to  cancel 
and  revoke  your  food  service  establishment  license; 

(c)  Prosecute  the  violation  as  a  misdemeanor  and  seek  criminal  fines. 

These  enforcement  actions  are  authorized  by  Section  50-50-106,  50-50-108, 
and  50-50-209,  M.C.A. 

Please  contact  ^health  department>  of  the  Missoula  City-County  Health  Department 
immediately,  ^e/she^  may  be  reached  at  721-5700,  ext.  364. 

Sincerely, 

ROBERT  L.  DESCHAMPS  III 
Missoula  County  Attorney 

By  


Robert  Slomski 

Deputy  County  Attorney 
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(f)  Mailing  the  printed  licenses  to  the  local  health  agency  will  constitute  the 
department's  notification  of  its  intent  to  issue  those  licenses. 

The  procedure  of  contacting  local  sanitarians  before  processing  new  or 
changed  applications  will  continue. 

(g)  The  fifteen  day  issue  period  is  calculated  froin  the  day  the  printed  license 
is  received  by  the  local  health  agency. 

(h)  The  v/ritten  notice  from  the  health  officer  to  the  applicant  indicating  a 
refusal  to  validate  the  license  must  be  specific.  The  grounds  for  the  action 
must  be  listed  together  with  the  sections  of  law  or  rule  in  violation. 

(i)  The  notice  should  explain  to  the  applicant  the  option  of  a  hearing  before 
the  local  board  of  health,  and  explain  the  procedure  for  requesting  the  hearing. 

(j)  The  notice  should  either  be  hand-delivered  to  the  applicant  or  sent 
certified  return-receipt  mail. 

GEN|_RAL: 

Sanitarians  are  advised  to  keep  their  health  officers  and  boards  of  health 
informed  of  all  licenses  subject  to  validation  refusal.  If  for  no  other  reason, 
they  will  be  deeply  involved  in  any  hearing  protesting  the  action. 

The  department  recomnends  pre-denial  consultation  between  local  health  officials 
and  the  department  to  better  assure  consistency  and  uniformity  of  action.  We  must 
avoid  the  charge  of  arbitrary  and  capricious  action  and  jurisdiction  to  jurisdiction 
variation. 

The  Department  of  Health  and  Environmental  Sciences  also  has  the  authority  to 
refuse  to  issue  a  license  under  the  authority  of  50-50-204  and  50-50-211. 

Since  both  the  local  health  agency  and  the  department  have  the  authority  to  deny 
the  issue  of  a  license,  and  since  the  grounds  for  action  by  both  agencies  is  generally 
documented  and  presented  by  the  local  sanitarian,  the  decision  to  proceed  through 
local  refusal  to  validate  or  department  denial  of  application  rests  with  the  local 
agency. 

Refusing  to  validate  a  license  is  a  potent  enforcement  tool.  Local  agencies 
must  use  it  wisely  and  guard  against  the  situation  which  finds  them  tolerating 
significant  violations  for  an  extended  period  of  time  in  order  to  reach  the  validation 
period.  Also,  care  is  necessary  to  prevent  the  situation  which  finds  the  validation 
of  a  license  by  the  local  authority  followed  closely  by  a  request  to  the  department 
to  cancel  or  revoke  the  license.  This  is  only  acceptable  if  sanitary  conditions 
change  significantly  betv/een  the  time  of  validation  and  the!  request  for  revocation 
action. 


i^k 

■^ 


/Ijc 
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(3)  Only  one    license   is  rcc^uircd  for  a  person  owiing  and 
operating  one  or  lixjre  vx^ndlng  machines. 

(4)  Before  a  license  may  be   is.sued  by  tiie  d-'partJix^nt  it  )mjst  Ijo 
validated  by   tiie  local  liealth  officer,   or  if  thei-e   Is  no  local 
health  officer  the  sanitarian,    in  the  county  where  the  establishment 
is  located. 

50-50-202. Piil)licly  ovviied  establisl-unent  exem^jt  from  lj^e_nsc  requi.r en-en t. 

Establishments  owned  or  operated  by  the  state  or  a  political 
subdivision  of  the  state  are  exenpt  from  licensure  but  must  comply 
with  the  requirements  of  this  chapter  and  rules  adopted  by  the  dcpartiront 
under  this  chapter. 

50-50-20.3. Application  for  U«n5e. 

>\n  application  for  a  license  is  made  to  the  departirent  on  forms 
and  contains   infonaation  rcquii-ed  by  the  departiiicint. 

50j^Uj^)4_^ RighlJo.Jicciise. 

Licenses  shall   be  granted  as  a  matter  of  right  unless  grounds 
for  denial  or  cancellation  exist. 

50-50-205.     License   fee . 

For  eacli  license   issued,   tiie  department  shall   collect  a  fee  of 
$20.      It  shall   deposit  receipts  in  the  state  general   fund. 

50-50-206.      License  not   transferable. 


LiceiLses  are  not  transferable  or  applicable  to  any  i)remises  other 
than   tliat   for  which   the   license  was   issued. 

50-50-207.     r.xjn i^i^t  i on  d. i tc   of  1  i cense. 

Licenses  expire"  on  IVxemljer  31   following  the  date  of  issue?  unless 
canceled  for  cause. 

50-50-208.      I/3cai  b_oa)d_ to  report  number  of  licensees  to  department. 

Before  June  1  of  eacli  year,    the  local  board  of  health  shall  submit 
to  tlie  department  a  list  of  tlie  establislmK:nts   in  each  jurisdiclion 
that  are  licensed  und(>r   this  chapter. 

50-50-209.     Ca nc\- 1  latjon  ^,)f i__ic.eiise . 

Ihe  departiii<_'nt  may  car.cel    a   license   if  it   finds,    after  proper 
investigation,    thai    the    licensee  has  violated   this  cha[)tcr  or  a 
rule  effective  under   tliis  chapter  and   tiio   licensee  has    failed  or 
refused   to   reiiiiHl\'  or  toirt/et   i  he   violation. 
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50-  50-210.     S  Lil^ni  ss  i  on  of  j)i  a  n  of  correction  as  bar  to  cancellation  . 

Submis'^ion  to  the  deparUxMit  of  an  acceptable  plan  of  correction 
within  10  days  after  receipt  from  the  department  of  written  notice 
of  violation  ajid  execution  of  an  acceptable  plan  within  the  time 
prescribed  in  tlie  written  notice  of  approval  of  the  plan  by  the 
department  shall  be  a  bar  to  prosecution  for  violation. 

50-50-211.     Ncnice  aj id_  hcni_r  ini',  required. 

'    A  license  iiuy  not  be  denied  or  canceled  by  the  department 
without  delivery  to  the  apijlicant  or  licensee  of  a  written  statement 
of  tlie  grounds   for  cancellation  or  denial  or  the  charge  involved  and 
an  opportunity  to  answer  at  a  hearing  before  the  department  to  show 
cause,    if  aay,  wliy  the  license  should  not  be  denied  or  canceled. 
In  such  case,    the  licensee  must  make  a  written  request  to  the 
department  for  a  hearing  within  10  days  after  notice  of  the  ground-s 
or  charges  has  been  received. 

50-50-212. Cancel  1  ation  of  license   for  nultiple-tyT^e  establishnvint . 

UTien  a  multiple -type  cstablishnicnt  is   licensed  by  the  deparLTent, 
tJie  denial  or  cancellation  of  the  license  m;iy  affect  the  entire 
establisliment  or  only  a  portion  of  it  as  determined  by  the  department. 
A  multiple- tyix,^  establisluient  includes  an  establishment  autlioiized  by 
50-50-201(2). 

50-50-215.     Return  of  license   for  alteration  or  destruction. 

On  cancellation  of  a  license  or  the  right  to  operate  one  or 
,;:ore  of  the  niiltiple-ty{)e  establishments  under  the  same  license,   the 
license  certificate  shall  be  returned  to  the  department  for 
destruction  or  deletion  of  types  of  establishment  as  the  department 
may  direct  in  its  notice  of  cancellation. 

^if  ■  50-50-214.     Not!  fi  cat  ion  of  and  validation  by  local  healt  h  officer . 

(1)  A  license   issued  by  the  department  uruler  Title  50,  c)\apters 

50  througli  52  is  not  valid  until  signed  by  the  local  health  officer 
in   the  county  where  tlie  establisl"u'!X.''nt  is    loaited. 

(2)  ITie  local  healtli  officer  shall,  wi;;iin  1!)  days  after  the 
department  lias  notified  tlie  local  health  officer  of  its  decision 
to  issue  a  license  under  Title  50,  clvipters  50  through  52,  make 
a  final  decision  on  v.hi.'lher  the  license  will  be  validated. 

(3)  failure  of   tli'-;   local   liealtli  officer   to  validate   tlie   license 
within  15  days  after   its   recei|)r    is  a   refusal. 
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V^  d^"       ^^^  '^9sJ-  ^-Li,    .%_^^':'i.'  L-!'/.  .i"'":.'  ^   health  officer  --   appeal   to  _board . 

(1)  T]\e  local  health  officer  ]ray  only  refuse  to  validate  a 
license  issued  under  Title  50,   chapters  50  through  52,   upon  a 

..  finding  that   the  requirensents  of  these  cliapters  and  any  rules 
inplementing  tiiern  are  not  satisfied.      If  the  local  health  officer 
refuses  to  validate   the  license,  he  shall  notify  the  applicant  and 
the  department  in  willing  stating  his  reasons. 

(2)  'Die  appljcant  or  any  person  aggrieved  by  the  decision  of 
the  local  health  offi'or  not  to  validate  a  license  may  appeal 
the  decision  to  the   l/i  a!   board  of  health  within  30  days  after 
receiving  written  v-.-ii'in  of  the  local  health  officer's  decision. 

(3)  The  hearin"  i':''^  e   the  local  board  of  health  shall  be  held 
pursuant  to  the  coirtcsted  case  provisions  of  the  ^bntana  Administrativi 

procedure  /'a:t , 


Part  3 
Inspections 


5^:^il"^'^i^     '!^'^^  ^-1  -9/iA?£^-_^  investigate  and  make  inspections . 

SState  and  local  healtli  officers,   sanitarians,  or  other  authorized 
persons  s!)a!J  unkc  investigations  and  inspections  of  establisrunents 
and  nuke  rci'orts    to  tl\e  department  as  required  by  rules  adopted  by 
the  department. 

50-50-302.    jieajth_  o_f_ficers   to  have   free  access. 

State  and  local  health  officers,   sanitarians,  and  other  autliorized 
persons  shall  have  free  access  to  establishments  at  all  reasoruablc  hours. 


2.13 


Chapter  50,   Section  50,   Nbntana  Code  AjuiotatoJ  '      '^'N 

Food  Establishments  "^ 

Page  8 


50-50-305.     Licensee  to  furnish  food  saniplus . 

Persons  licensed  imder  part   2  sliall   funush   food  samples   for 
analysis  as  re(|uired  by  rules  adopted  by  the  department. 

50-50-304.     Discovery  o(    food  capable  of  causing   food-bonio   i  1  Inei^s . 

If  a  state  or  local  health  officer,   sanitarian,   or  other 
authorized  person  finds   food  that  is  capable  of  causing   food-borne 
illness,   he  sliall  issue  a  report  in  writing  recommending  that  the 
food  be  withheld  from  sale  to  the  public.     A  duplicate  co[)y  of  the 
report,   properly  authenticated,  is  admissible   in  evidence   in  any 
action  or  proceeding  where   the  condition  of  the   food  at   tb.e   tiine  oi: 
tJie  inspection  is  iiuiterial. 

50-50-505.      l,)eparDi;en':   to  pay    local   boj^ind   fot_  ixi^pt'cUoi,/- . 

(1)  Ik^fore  June   .^0  of  each  year,    the  dcpartin-nt   shall   jviy   to  a 
local  board  ol'  hc-alf_!i,   as  establislicd  u.'ider  SO-^-lO-l,    SO-'.MOi), 
or  50-2-107,   aii  :iiiiount  from  any  gencial    fimd  appropriation     ti: 
the  departirent  whicli  is   for  the  puq^ose  of  inspecting  cst.iblisl!- 
mcnts   licensed  under  this  chapter;   provided,  hoivever,    that,  there 
is  a  functioning  local  board  of  health  and  that   the  local  board 
of  health,    local  healtli  officers,   and  sanitari;uus  assist    in  the 
enforcement  of  the  [u-ovisions  of  tb,is  chai)ter  and  the  rules 
adopted  Uiuler  it. 

(2)  'Die  funds  received  by  the  loca]   board  of  iiealtb.  shall   be 
deposi  ted  witli   the  appropriate   locaj    fiscal  autliority  and  shall 
be  in  addition  to  tlie   funds  appropriated  luider  50-2-108  througii 
50-2-114. 


Part  4 
J'ro.-'.en  Food  U)ckers 

50-50-401 . ^nii^i;inj^  or  (Icclai-atjon  re<piirements   for  stored  j^-a  t. 

(1)      The  owner  or  opeiator  of  an  establishment,    as  dc  fir,cd  in 
iJiis  ciiapter,   shall  not  riceive  the  carcass  of  a  gamt^  anir;ia], 
game  bird,   or  an)-  (luarter,   half,   or  whole  carcass  of  beef  or 
veal   aalcss: 

[:■.')      it    1-;  priipeily   staiii|ied  or   tagged;   or 
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Section  3 
cost  of  the  licensed  food  establishment  program 

Results  -  The  Foodservice  (restaurants  and  bars)  Inspection  program  cost  the  Missoula 
Health  Department  $19,^*11  in  FY  I98I.   The  cost  includes  $11,3'*'<  in  personnel 
costs,  $h,kG^    in  mileage  costs,  and  $3,^03  in  health  department  overhead.   The 
overage  cost  of  the  program  per  establishment  is  $73. 

Discussion  -  Cost  information  is  easy  to  collect.   Personnel  time  can  come  from 
department  time  sheets  or  from  actual  inspection  time  recorded  by  sanitarians  on 
the  inspection  form.   The  more  accurate  the  inputs  (time,  mileage,  etc.),  the  more 
accurate  the  cost  analysis. 

Methodology  -  See  detailed  methodology  printed  on  the  back  of  the  program  cost  analysis. 


Section  3,  Page  1 


OVtRHKAD 
He.ilth   Department   Cost  Anii 


;(.•;.'./  /.(•  .!.-li:>'*niti,;  Li--  (>,'•  imend,   or   "cout  aj'  >:   'u.i  ;  .(.-.i .;;.;,  " 

<m  (I  I'lU'.fi.iiL'.'ji:  Ihiuir.  mi  Itiat  ovvrhr-uti  eoiU.:  ,;in  In;  J'.n'rlii  n'liKuili 


I.      Administrative   Salaries 
a.    Health  Officer 


b.  Administrative  Assistant 

c.  Ad.iiinistrnl  ive  Sucrolary 

d.  H.O.  Receptionist 
o.  H.D.  Accountant 

f .  Viuil  Statistics  Clerk 

9.  Medical  Consultant 

h.  Other: 


(fringe) 


TT 


2.   Other  Administrative  Personnel  Expenses 
a.  Tc:i  mi  nation  R.-si  1  vc 


b.  Recruitment 

c.  General  Conferences  6  Meetings 

d.  General  Training 

e.  General  Bo<jlcs  6  Periodicals 

f.  Administrative  Travel 

g.  Other: 
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3-   Other  Administrari 


Expenses 


a.  All  Office  Supplies 

b.  All  Copies  and  Printing 

c.  Al 1  Postage 

d.  Office  Equipment  £  Maintenance 

e.  All  Telephone  Charges 

f.  Interest  on  Warrants 


Buj^lding  and  Maintenance 

3-  Rent  OR  $ per  sq.  foot 

X  number  of  sq.  feet  of  offic 


c.  Utilities 

d.  Insurance 

e.  Other: 


TFT 


5-   Other  Overhead  Expenses 
Other: 


bui Iding  and 
id)    niaintenance 


liT 


TOTAL  OVERHEAD  COSTS 


Overhead  Comput 


CZ] 


total  H.D.  sal 


OVERHEAD  (30?;) 
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OVERHEAD 
Health  Department  Cost  Analysis 

Ovci'hciil  ir,   a  J'iu!loi'  d^aigiwd  to  calaulatt:   the   total  coats  of  acimin- 
■i.iiict'inii  a  pi'0{n'<Mn.      It  should  bti  noted  that  overhead  ia  an  estimation 
of  the  healthy  dcpartimnL  'j;  adrdni  strati  on  of  all  department  programs, 
(ill-  of  tohiah  overlap;   hence,    the  need  for  an  overhead  firjure. 

Total  Administrative  Salaries 

This  means  salaries  plus  appropriate  yearly  fringe  benefits  and  merit  raises 
of  only  personnel  Involved  in  the  general  administration  of  the  health  department. 
(Other  personnel  may  be  added  if  other  departments  are  organized  differently. 
Tor  ox.iniplo,  a  health  department  personnel  director  or  assistant  health  officer 
'.lioiild  ht'  .idded  to  this  cotef|ory.)  The  receptionist  is  I  he  person  who  act',  for 
iIk'  entire  hcilth  dcp.ulriienl  ,  Ihc  (jencrnl  office  clerk  (or  .1  porlioii  of  her/liis 
salary)  arts  as  vital  statistics  clerk. 

To  calculate  (a),  or  total  administrative  salaries,  multiply  total  salaries 
(which  should  include  yearly  raises)  by  yearly  fringe  percentage. 

Other  Administrative  Personnel  Expenses 

"Termination  Reserve"  means  those  monies  set  aside  to  pay  vacation  and  sick  pay 
severance  to  employees  who  quit.   "Recruitment"  means  costs  budgeted  for  ncv;spaper 
ads,  printing  and  other  costs  of  filling  vacant  positions.   "Conferences  and 
Meetings"  refers  to  those  of  general  Interest  to  health  administration  and  not 
applicable  to  a  specific  program.   "Training"  means  general  mangcment  or 
administrative  training,  not  that  attributable  to  a  specific  program.   The  "Books 
and  Periodicals"  category  Includes  general  health  planning,  public  health,  and 
management  iiiaterials  of  general  interest  and  not  attributable  to  a  specific 
program.   "Travel"  means  general  health  department  trips  and  excludes  travel  for 
specific  programs  or  conference  travel  (to  be  Included  under  "Conferences  and 
Meetings").   Blanks  are  provided  for  other  categories  specific  to  the  general 

adniinistrat  ion  of  a  health  department.   Add  all  these  categories  to  get  Total  |jS 

Administrative  Personnel  Expenses  (b) .  V. 

Other  Admini strat ivc  Expenses 

Expenses  In  this  category  are  those  which  are  general  to  the  running  of  an 
agency.   Since  it  is  virtually  impossible  to  split  out  the  number  of  pencils, 
pieces  of  paper  and  the  like  used  by  one  program  or  activity,  It  is  a  good  deal 
easier  to  Include  these  as  a  total  category  and  be  able  to  easily  allocate  them 
in  the  department  overhead  computation.   (The  only  exception  to  this  would  be 
grants  where  administrative  expenses  are  each  listed  and  funded  separately  and 
should  be  allocated  as  such.)   Office  supplies,  copies  and  printing,  postage, 
office  equipment  and  phone  are  total  costs  per  year  for  the  whole  department 
extopting  grant  allocations.   Interest  on  warrtints  is  interest  paid  on  monies 
borrowed  from  a  bank  to  cover  current  department  operating  expenses  (if  applicable). 
Other  ndmini stral i vo  expenses  should  be  Included  in  this  category  if  they  are 
attributable  to  the  general  operation  of  a  department.   (Note:   It  is  more  accurate 
and  easier  to  charge  vehicle  expenses  to  the  program  which  uses  them  on  a  cents- 
per-mile  basis.   It  is  also  a  good  deal  more  difficult  to  charge  phone,  office 
space  and  the  like  out  on  a  prog  ram -by -prog  ram  basis.) 

Bu  i 1 d I ng  and  Maintenance 

Housing  costs  are  to  be  included  In  the  overhead  computation  because  of  tlie 
difficulty  of  allocating  square  footages,  utilities,  phones,  etc.,  to  each  program 
or  activity.   This  category  should  cover  all  housing  expenses  of  the  department 
and  laboratory. 

Other  Expenses 

This  category  should  include  costs  of  routine  audits,  administrative  consultants, 
depreciation  on  capital,  or  other  similar  items. 


for  fy  

actual 

estimated 


Licr;NsnD  food  establishmont  program 

Cost  Analysis 

This  oost  analysis  provides  a  formula  to  determine  the  costs  to  the 
Health  Department  of  conducting  the  Licensed  Food  Establishment  Program. 


1.  PERSONNEL 

a.  Sanitarian  time  x  (salary  +  fringe) 

b.  Clerical  time  x  (salary  +  fringe) 

c.  Other: 

2.  ENVIRONMENTAL  HEALTH  ADMINISTRATIVE  COSTS 

a.  Environmental  Health  Director 

b.  Supervising  Sanitarian 

c.  Other: 

?>.    HEALTH  DEPARTMENT  OVERHEAD 
%   of  total  personnel  costs 

4.  MILEAGE  @  ^/raile 

5.  TRAINING,  BOOKS  AND  PERIODICALS 

6.  OTHER: 


total  personnel 
costs 


Total  Program  Costs 


3.4 
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PROCEDURE 
Licensed  Food  Establishment  Program  Cost  Analysis  \f 


Note:     Each  health  department  has  its  own  system  of  tracking  personnel  and 
mileage  costs.      This  cost  analysis ^   designed  to  provide  the  most  convenient 
method  of  determining  program  costs,   can  he  changed  to  reflect  the  department^ 
apecific  situation. 

1.  PliRSQNNEL  -  There  are  several  ways  to  calculate  personnel  time:  (1)  from 
department  or  division  time  sheets,  (2)  from  inspection  time  taken  from 
tlic  inspection  form,  or  (3)  from  estimates  derived  from  a  time  study. 
Personnel  time  should  include  time  spent  on  the  telephone  as  well  as 

on  less  obvious  activities.   Use  hourly  salary  figures  (or  an  average, 
if  more  than  one  sanitarian  is  involved)  and  add  the  appropriate  fringe 
benefit  percentage. 

2.  ENVIRONMENTAL  HEALTH  ADMINISTRATIVE  COSTS  -  This  category  shows  direct 
administrative  costs  which  are  the  costs  of  directing  and  supervising 
the  program.  These  costs  can  be  calculated  as  a  percentage  of  total 
program  personnel  costs  if  better  data  is  not  available  (10%  is  a  good 
rule-of -thumb) . 

3.  HEALTH  DEPARTMENT  OVERHEAD  -  This  category  provides  a  way  to  include 
building,  maintenance,  and  general  health  department  administration 
(health  officer,  accountant,  and  other  administrative  support)  in 
program  costs.  See  Overhead  Cost  Analysis  to  determine  health 
department  overhead  percentages. 

4.  MILEAGE  -  If  accurate  records  are  not  available,  mileage  can  be  calculated 
as  a  proportion  of  total  environmental  health  time,  or: 


total  lie,   food  estab.   program  hours 
total  env.    hlth.   hours 


X% 


2.   X%  times  Total  Yearly  Mileage  =  Lie.   Food  Estab.   Proportional 

Mi] 


5.  TRAINING.  BOOKS  AND  PERIODICALS  -  These  should  be  only  costs  specific  to 
the  Licensed  Food  Establishment  Inspection  Program.   Costs  which  are 

general  should  be  allocated  to  Department  overhead  (see  Ov.erhead  Cost  Analysis) 

6.  OTHER  -  Any  other  costs  not  already  included  in  the  above  five  categories. 
This  could  include  terminal,  line  and  computer  charges  for  the  SPIF  Program. 
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estimated 


LICENSED  FOOD  ESTABLISHMENT  PROGRAM 
Cost  Analysis 

Thii-  cost  analysis  provides  a  formula  to  determine   the  costs   to   the 
Health  Department  of  aonduating  the  Licensed  Food  Establishment  Program. 


1.  PERSONNEL 

;i.  Sanitarian  time  x  (salary  +  fringe) 

5PIF.  <L^   C    3SHIM  /iMtp.  y  </r"ou^.   Saui  MJIOLib 

ffO  M.»/.  to..  y.90 

b.   Clerical  time  x  (salary  +  fringe) 


c.  Other:  r./  .     +. 

2.  ENVIRONMENTAL  HEALTH  ADMINISTRATIVE  COSTS 

a.  Environmental  Health  Director 

(2/i-/uy.  46H.  /,w  ^UM(  vi.oa.+  so-j-fr.; 


b.  Supervising  Sanitarian 

esr.   AT     t  Itr./ujt^.      >  s-i  **«• 

c.  Other: 


HI^Al.TH  DEPARTMENT  OVERHEAD 

30-6  of  total  personnel  costs  Cii,3«/V) 


^'sa/*/ 


uzz 


.JUaiA- 
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4.    MILEAGE  @    zO  if/mil e 


5.  TR>\TN1NG,    BOOKS  AND  PERIODICALS 

6.  OTOER:  (^SflF   |«r»^.««.{    ^    ^  KtJ*o.rtL    F»J  «>    omcv) 


II  i*^^  total  personnel 
cos  ts 

3^03 
2QO 


Total  Program  Costs 


7f.  v// 


7lo1  eSTAt. 
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Section  ^ 
establishing  a  risk  score 

Results  -  The  purpose  of  developing  a  risk  score  is  to  have  an  uncomplicated,  yet 
effective  way  to  predict  the  public's  risk  of  eating  at  an  establishment.   With 
that  information,  we  want  to  be  able  to  know  when  to  allocate  personnel  and  resources 
to  establishments  having  highest  risks. 

The  Missoula  Risk  Model  is  based  on  information  readily  available  from  the  Food 
Service  Establishment  Profile  Form  (See  Section  l). 

Testing  the  formula  showed  that,  in  general,  2A-hour  full-service  establishments 
pose  about  two  times  the  risk  as  a  pizza  establishment,  and  bars  with  food  pose 
slightly  more  risk  than  fast-food  establishments. 

We  will  continue  to  test  the  risk  formula  in  FY  1982  to  see  if  it  could  be 
computerized  and  also  made  more  sensitive,  while  maintaining  its  simplicity. 

Discussion  -  There  has  been  long-standing  Interest  in  an  accurate  risk  formula  to 
be  used  in  allocating  program  resources,  but  there  are  significant  problems  with 
such  a  formula.   The  main  problem  is  how  complicated  a  complete  model  could 
become.   In  addition,  extremely  accurate,  subjective  inputs  are  too  costly  in 
terms  of  sanitarian  and  statistical  time  needed  to  gather  and  compute  the  informa- 
tion. 

Along  with  constraints  that  information  for  the  formula  be  easy  to  collect  and 
the  formula  itself  be  easy  to  calculate.  Is  the  danger  that  the  formula  could  become 
useless.   While  common  sense  and  experience  could  say  that  full -service  restaurants 
pose  twice  the  risk  as  a  fast-food  establishment,  the  formula  does  give  an  objective 
and  qualitative  analysis. 

Methodology  -  The  formula  currently  being  tested  uses  information  from  the  SPIF 
Profile  Record. 


Risk  Score  =  ^ MMMM 

2(average  last  3  inspections) 


a  =  Type  of  Establishment 

restaurant  -  10.0 

bar  and  food  -  9-0 

bar  with  food  -  5.0 

pushcart  -  7.5 

b  =  Type  of  Service 

full  service  -  10.0 

buffet  -  9.0 

caterer  -  8.0 

fast  food  -  7.5 
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=  Meal  Volume  Per  Week 

j:  500   -  A.O 

501-1000  -  5.5 

1001-2000  -  7.0 

2001-AOOO  -  8.5 

>  ijOOO  -  10.0 


d  =  Hours  Per  Day 

2A-hours  -  10.0 

23-18  hours  -  8.0 

<  18  -  6.0 

See  page  h.3   for  examples  of  the  testing, 
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TEST  OF 
Licensed  Food  Establishment  Risk  Formula 


(type  est.)   (type  service)   (meal   vol.)   (hours) 
risk  formula  =  2  (ave.   last  3  inspections) 


24  Hour,   Full -Service  Restaurants 


58.14 


A. 

10  X  10  X  10  X 

10  _ 

B. 

2(86) 
10  X  10  X  10  X 

10  _ 

C. 

2(88.7) 
10  X  10  X  8.5  ) 

<  10  . 

2(87.7) 
Pizza-Type  Restaurants 

A. 

10  X  10  X  8.5 

X  6 

B. 

2(94.3) 
10  X  10  X  7  X 

6 

Fa 

2(92) 
st-Food  Restaurants 

A. 

10  X  7.5  X  8.5 

X  6  . 

Ba 

2(90) 
r  With  Food 

A. 

9  X  7.5  X  8.5  X  8 

56.37 


48.46 


"2T94y 


27.04 


=  22.83 


=  21.25 


24.41 


Large,  Full -Service  Restaurants 
A.   10x10  X  8.5  X 


2(83) 

B.   10  X  10  X  8.5  X  10 
2(81.3) 


40.96 


52.27 


A. 3 
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>_^  Section  5 

licensed  food  establishment  program 

Evaluation  Plan 

Of  all  types  of  business  in  the  U.S.,  the  food  and  beverage  service  industry 
has  been  ranked  fourth  in  size.  Estimates  show  that  Americans  spend  $1^5 

billion  per  year  for  food  and  drink  consumed  both  in  emd  out  of  the  home 

32 
and  eat  an  average  of  150  million  meals  daily  in  food  establishments. 

Further  approximations  show  that  27!{  of  America's  food  dollar  is  spent  on 

pO 

food  prepared  outside  of  the  home,   an  amount  increasing  yearly. 

Socioeconomic  changes  have  resulted  in  the  increasing  popularity  of  eating 
out  —  people  are  more  prone  to  eat  lunch  out  because  of  distances  from  their 
work  place  to  their  home;  the  food  and  beverage  industry  has  heavily  promoted 
the  sociable  effects  of  eating  out;  the  fast  pace  of  modem  life  more  and 
more  often  includes  eating  out;  and  food  variety  has  changed  so  that  patrons 
may  choose  from  a  large  and  varied  selection  of  food. 

Public  demand  on  the  food  service  industry  means  that: 

^-,  More  persons  will  be  eating  meals  away  from  home.  Hence, 

^  more  persons  than  ever  will  be  at  risk  in  the  event  that 

mishandling  of  food  results  in  an  outbreak  of  foodbome 
illness.  Second,  the  greater  demands  of  consumers  on 
existing  facilities  may  result  in  temporary  lapses  in 
proper  food  handling  techniques. ^2 

Nationally,  the  objectives  of  the  Licensed  Food  Establishment  Program  are 

to: 

1.  prevent  foodbome  illness 

2.  protect  food  from  contamination 

3.  insure  the  soundness  of  food 
k.     meet  consumer  expectations. 

Montana's  goals  are  no  different.  Since  the  beginning  of  its  Licensed  Food 
Establishment  Program  in  the  early  1920 's,  the  State  Department  of  Health 
and  Environmental  Sciences  and  local  health  departments  have  conducted  programs 
to  inspect  establishments,  educate  managers  and  food-service  employees, 
consult  and  advise  on  food  service  problems  and  investigate  suspected  cases 
of  foodbome  illness. 
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The  State  and  local  health  departments,  interested  in  evaluating  their  Licensed 
Food  Establishment  Programs, began  the  process  as  a  Joint  State-local 
Evaluation  Committee.  Their  needs  for  quantitative  and  qualitative  data 
to  use  in  program  planning  and  allocation  of  resovirces  were  formalized  with 
the  approval  of  a  two  year  research  evaluation  grant  between  the  State 
Department  of  Health  and  Environmental  Sciences  and  the  Missoula  City- County 
Health  Department,  contractor  for  the  project.  The  Missoula  Health  Depart- 
ment is  responsible  for  developing  evaluation  models  for  eight  public  health 
programs,  and  testing,  revising  and  distributing  "user  guides"  to  State  and 
local  health  departments  for  their  use  in  self-evaluation. 


Literature  Review 

A  comprehensive  literature  search  was  conducted  to  review  current  evaluation 
of  licensed  food  establishments  and  to  explore  different  ideas  in  the  field. 
A  good  deal  of  relevant  information  is  available  about  restaurant  inspection 
frequencies,  risking  formulas  and  foodbome  Illness,  some  of  which  is  reviewed 
below  (for  complete  bibliography,  see  page  23): 


Zakij   M. ,   MilleVj   G.,   et.al. 
"A  Progressive  Approach  to  the 
Problem  of  Foodbome  Infections''^^ 


Bader,  M.  ^   Blonder ^   £". ,  et.al. 
"A  Study  of  Food  Service  Estab- 
lishment Sanitation  Inspection 
Frequency "2 


Kaplan,    O.B.y   El-Ahraf,   A. 
"Relative  Risk  Ratios  of  Food- 
bome Illness  in  Foodservice 
Establislvnents:     An  Aid  in 
Deployment  of  Environmental 
Health  Manpower.  "^^ 


Food  samples  from  39  retail  stores  were 
analyzed  for  bacterial  contaminents  to 
explore  the  feasibility  of  using  micro- 
biological standards  in  enforcement. 
A  total  of  450  retail  food  establishments 
were  inspected  once  and  then  again  six 
months  later  with  62%  and  67%  acceptable 
ratings  respectively.      The  authors  feel 
the  scoring  system  is  of  limited  value 
for  determining  re-inspection  or 
frequency  of  inspection. 

This  study  showed  that  in  food  service 
establishments  which  had  consistently 
maintained  satisfactory  sanitation,   re- 
ducing their  inspection  frequency  from 
four  times  per  yeoj'  to  once  a  year 
resulted  in  some  decline  in  sanitation 
levels. 

Noting  that  there  was  no  available   litera- 
ture providing  reliable  risks  of  foodbome 
illness,   the  authors  devised  a  ratio  to 
determine  relative  risks.     The  implication 
is  that  there  is  no  basis  for  the 
traditional  belief  that  all  establishments 
must  be  inspected  a  given  number  of  times 
per  year. 


5.2 


Licensed  Food  Establishment 
Page  3 


Denis  ton  3   0.    and  Wetoh,    W. 
"Evaluation  of  Performance  of 
a  Food  Sanitation  Program. "^0 


Bryan,    F. 

"Impaot  of  Foodbome  Diseases 
and  Methods  of  Evaluating  Control 
Programs. "^ 


Levy,   B.    and  Mclntire,    W. 
"The  Eaonomia  Impact  of  a 
Food-Borne  Salmonellosis 
Outbreak. "^^ 


Using  a  standard  of  foodservice  violations 
and  correction  rates,    this  study  suggests 
that  in  a  district  which  was  not  inspected 
for  a  period  of  time,    the  ratings  would 
decline  in  the  absence  of  a  program. 

Author  believes  that  licensed  food  estahlish- 
ment  program  managers  cannot  rely  on  a 
change  in  the  incidence  of  foodbome  disease 
outbreaks  to  determine  the  effectiveness 
of  prevention  activities .      Further,   changing 
programs  to  concentrate     on  factors  directly 
causing  foodbome  illness  will  demonstrate 
a  change  as  a  result  of  program  activity. 

A  salmonellosis  outbreak  which  affected  125 
people  was  analyzed  and  the  economic  impact 
of  the  outbreak  was  estimated  at  $28,733. 
Authors  judged  that  the  costs  of  preventive 
programs  were  much  less  than  the  economic 
impact  of  foodbome  illness. 


These  articles  and  others  cited  in  the  bibliography  are  good  background  for 
licensed  food  establishment  evaluation.  Although  literature  in  the  field  at 
times  is  conflicting,  there  are  quality  evaluation  attempts  upon  which  to 
base  this  evaluation  project. 

A  particular  effort  was  made  to  contact  program  managers  and  other  experts 
for  their  input  and  advice. 

•  Joe  Aldegarie,  Environmental  Health  Director,  David  Feffer,  Health 
Officer,  Missoula  City-County  Health  Department,  Missoula,  Montana. 

•  Will  Selser,  Environmental  Health  Director,  Bob  Johnson,  Health  Officer, 
Lewis  and  Clark  Health  Department,  Helena,  Montana. 

•  Jim  Neely,  Environmental  Health  Director,  George  Sheckleton,  Health 
Officer,  Yellowstone  County  Health  Department,  Billings,  Montana. 

•  Tom  Cowan,  Environmental  Health,  Bruce  Mclntyre,  Health  Officer,  Flat- 
head City-County  Health  Department,  Kalispell,  Montana. 

•  Pete  Frazier,  Environmental  Health  Director,  Don  Pizzini,  Health  Officer, 
Cascade  City-County  Health  Department,  Great  Falls,  Montana. 

•  Emery  Nelson,  Sanitation  Division,  Edward  King,  Health  Officer, 
Gallatin  City-County  Health  Department,  Bozeman,  Montana. 

•  Bill  Burke,  Health  Officer,  Silver  Bow  Health  Department,  Butte,  Montana. 

•  Jim  Peterson,  R.S.,  Consultant  Sanitarian,  Vem  Sloulin,  R.S.,  Chief, 
Food  and  Consumer  Safety  Division,  State  Department  of  Health  and 
Environmental  Sciences,  Helena,  Montana. 
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•  Denzll  Inman,  Food  Service  Specialist,  FDA,  Denver,  Colorado. 

•  Charles  Bartleson,  Food  Program  Consultant,  Washington  State  Health 
Department,  Olympia,  Washington. 

•  Doyle  Parton,  Salt  Lake  City  Health  Department,  Salt  Lake  City,  Utah. 

•  John  Insel,  Chief,  Consultation,  Certification  and  Evaluation, 
Michigan  Health  Department,  Lansing,  Michigan. 

•  Frank  Bryan,  Institutional  Services  Division,  Center  for  Disease  Control, 
Atlanta,  Georgia. 

•  Amer  El-Ahraf,  Department  of  Health  Sciences  and  Human  Ecology, 
California  State  College,  San  Bernardino,  California. 

•  A.  A.  Heame,  Environmental  Health  Services  Manager,  Department  of 
Health  Services,  Los  Angeles,  California. 

•  Others. 


Method  of  Prooedure 

Restaurant  inspections  take  more  time  and  resources  than  inspections  of 
other  licensed  establishments,  so  this  evaluation  will  cover  only  restaurant 
inspections  and  not  grocery  stores,  meat  markets,  bakeries,  vegetable  markets, 
caterers,  bottlers,  other  food  processors,  hotels,  motels  and  trailer  courts 
(which  pose  the  lesser  health  risk  to  the  public).  A  second  parameter  of  the 
evaluation  will  be  the  assumption  that  the  restaurant  inspection  program  does 
reduce  the  risks  of  foodbome  illness  and  insures  correction  of  hazards,  although, 
until  qualitative  research  is  conducted,  the  extent  of  prevention  must  remain 
unknown. 

Evaluation  of  the  Licensed  Food  Establishment  Program  is  complicated  by  the 
many  facets  of  restaurant  inspection.  The  ^^l-item  inspection  form  is  currently 
used  to  record  sanitation  problems  foimd  in  restaurants.  Criticisms  of  that 
system  center  around  (1)  lack  of  sanitarian  standardization;  (2)  variances 
which  can  occur  in  restaurant  sanitation  from  rush  hours  (holidays,  weekends, 
early  morning  and  late  night)  to  actual  inspections  done  on  an  8-5  weekday 
schedule;  (3)  the  argument  put  forth  by  some  who  say  that  the  inspection  form 
cannot  truly  reflect  disease  risk;  (k)   violation  correction  and  enforcement 
variations;  and  (5)  measurement  of  the  health  impact  upon  the  public. 

Taking  the  myriad  problems  of  restaiirant  inspection  into  consideration, 
most  involved  in  the  field  do  agree,  however,  that  the  current  inspection 
methodology  remains  the  best  available  until  more  holistic  procedures  become 
widespread,  hence,  the  assumption  and  parameters  above. 
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With  those  constraints  in  mind,  each  licensed  food  establishment  evaluation 
objective  will  serve  as  a  specific  measure  of  that  part  of  the  program's 
effectiveness  and  efficiency.  Each  objective  and  its  evaluation  procedure 
is  designed  to  be  easily  modified  to  fit  individual  health  department  data 
needs.   (For  example,  the  time  deadline  in  Objective  k   may  be  changed  to 
realistically  reflect  staffing  and  workload  requirements  of  an  individual 
health  department.) 

Each  evaluation  objective  will  follow  the  same  format:  (1)  the  rationale 
for  the  objective  will  be  discussed,  (2)  methodology  to  measure  attainment  of 
the  objective  will  be  detailed,  and  (3)  the  uses  of  the  data  by  program 
managers  will  be  discussed. 

-  1.  To  establish  and  maintain  the  SPIF  program 
to  provide  complete  and  timely  management 
data. 
To  conduct  the  restaurant  inspection  program 


OBJECTIVES*  BY  FISCAL  YEAR 


S0^ 


.,ti' 


2. 


C,0<? 


t1< 


based  on  the  public's  risk  of  becoming  ill 

after  eating  at  different  categories  of  licensed 

food  establishments. 

To  eliminate  all  k-   and  5-point  items  fo-and  during 

inspection  at  least  within  10   days  of  inspection 

date.  ^nad.-       x)Oi  '^ 
^(X^^    see  vy 

By  Jonuarn/  1981,   all  establishments  failing    , 
to  meet  sanitation  standards  or  who  have 
shown  a  decrease  in  at  least  2   of  the  pa^t 
3  regular  inspection  scores  will  have  enforce- 
ment action  taken. 

To  explore  the  feasibility  of  conducting  a  -r^ife^^^'^ 
program  to  determine  the  incidence  of  food-  S«®  "^^ 
borne  illness  in  the  county. 

To  standardize  all  sanitarians  by  January  1.981  j  -- 

so  that  establishment  scores  are  within  80%     co^'^rpC^^-'^'^ 


<v«- 


i 


of  the  standardizer's  score  100%   of  the  time. 


*variables  in  italics 
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7.  To  determine  the  costs  of  conducting  the      \io'^^- 
Llcensed  Food  Establishment  Program.    ^^^ 

Objective  1.  To  establish  and  maintain  the  SPIF  program  to  provide  complete 
and  timely  management  data. 

Rationale  -  Licensed  food  establishment  inspection  workloads  are  heavy  for 
most  health  departments,  so  having  good  data  from  which  to  base  resource 
allocation  Is  Imperative.  Inspection  programs  are  more  and  more  tending  toward   ^ 
inspecting  non-crltlcal  establishments  less  often  and  inspecting  more  critical    ^h 
establishments  more  often  (Cox  and  Wilson,^  Kaplan,  -"^   Bader,  Blonder,       ^ 
et.al.,  Zakl  ).  In  addition,  records  of  sanitarian  consistency,  district 
variation,  historical  trends  of  demerit  scores  and  workload  are,  if  kept  at 
all,  kept  manually, usually  by  sanitarians. 

Methodology  -  For  several  years,  environmental  health  personnel  in  Montana  have 
been  Interested  in  a  new  concept  for  the  Licensed  Food  Establishment  Program 
known  as  SPIF  (Sanitation  Programs  Information  Formulator) .  SPIF  is  a 
computerized  system  which  takes  information  from  the  ^^-point  inspection  form 
and  compiles  and  files  it  so  that  any  or  all  of  22  separate  reports  can  be        jC' 
provided  to  either  program  manager  or  local  sanitarian. 
Some  of  the  information  produced  by  SPIF  Include: 

•  establishment  profile  listing 

•  historical  inspection  results  for  each  establishment 

•  scoring  levels  and  workload  per  sanitarian 

•  violation  statistics  by  type  of  violation  for  set  time  period  per 
locality 

•  list  of  establishments  to  be  inspected  within  pre-established  time 
frame 

•  report  on  previous  inspection  results  for  each  establishment 
(See  pages  15-16  for  complete  list.) 

The  Missoula  City-County  Health  Department  has  contracted  to  receive  the 
federally-sponsored  software  package  from  the  FDA  and  will  begin  using  SPIF 
in  early  fiscal  year  I98I.  The  procedure  Involves: 

1.  Filling  out  a  Profile  Formfor  each  establishment  listing  the  establish- 
ment name,  ID  number,  location,  type  of  service,  meal  volume,  water 

supply.  Inspection  Interval,  etc.  (See  page  17).  d^ 

2.  Completing  the  ^i^-item  inspection  form  as  usual,  and  then  a  clerk 
will  key  in  the  Information  on  the  terminal. 
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3.  Any  of  22  reports  can  be  called  up  as  needed  on  the  CRT  terminal 
and/or  paper-printed  later. 
Staff  and  management  training  is  provided  by  SPIF's  originators,  Opportunity 
Systems,  Inc.  as  part  of  the  total  SPIF  package.  After  training  and  program 
installation,  the  Missoula  Health  Department  and  the  Missoula  Data  Processing 
Department  will  be  responsible  for  entering  the  data  and  running  the  program. 

Use  of  Data  -  With  the  SPIF  system,  program  managers  and  sanitarians  have 
easy  access  to  detailed,  timely  and  accurate  management  data.  There  is  also 
the  potential  to  expand  the  program  later  to  the  sewer  system  inspection 
program  and  for  Missoula  to  conduct  contract  work  for  other  health  departments 
who  would  like  to  receive  SPIF  data  but  do  not  have  data  processing  capabilities. 

Objective  2.  To  conduct  the  restaurant  inspection  program  based  on  the 

public's  risk  of  becoming  ill  after  eating  at  different  categories 
of  licensed  food  establishments. 

Rationale  -  When  the  concept  of  a  "relative  risk  ratio"  was  introduced  several 
years  ago,  it  was  the  outgrowth  of  concern  in  the  field  over  a  way  to  fairly 
allocate  numbers  of  inspections  to  establishments  posing  different  hazards. 
In  effect,  an  administrator  able  to  predict  the  foodbome  illness  risk  of  each 
type  of  food  service  establishments  could  increase  surveillance  of  high-risk 
establishments  and  decrease  surveillance  of  low-risk  types  of  establishments. 

Methodology  -  Pixjgram  administrators  have  expressed  a  need  for  a  fair  and 
consistent  way  to  allocate  their  licensed  food  establishment  resources,  or 
restaurant  inspections.  Some  work  has  been  done  on  a  nation-wide  basis, 
most  notably  Kaplan's  relative  risk  ratio. 

In  Montana,  the  Cascade  City-County  Health  Department  is  working  with  a  "Food 
Service  Establishment  Hazard  Potential"  which  takes  into  consideration  the: 

•  extent  of  potentially  hazardous  foods  served 

•  extent  of  handling  and  preparaticm,  of  potentially  hazardous  foods 

•  hours  of  operation 

•  persons  served 

•  maintenance  demand  of  facility  and  equipment. 
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Cascade  County  is  also  evaluating  the  use  of  four  inspection  frequencies 
where  Group  I  is  a  control  group  receiving  routine  twice  per  year  inspections; 
Group  II  consists  of  establishments  inspected  on  a  quarterly  basis;  Group 
III  receives  in-depth  inspections  (i.e.,  four  inspections  in  one  day  occurring 
at  8:00  A.M.,  12:00  noon,  5:00  P.M.,  and  9:00  P.M.);  and  Group  IV  is  inspected 
monthly.   (For  complete  explanation  see  pages  18-22.) 

In  order  to  test  other  methodologies  and  compare  data,  this  evaluation  will 
consist  of  developing  and  testing  a  risk  formula  based  on  information  already 
collected  on  the  "Profile  Form"  of  the  SPIF  program  —  type  of  establishment, 
type  of  service,  weekly  meal  volume,  sewage,  hours  of  operation,  plus  in- 
spection score  and  other  factors,  each  multiplied  by  a  mathematical  "hazard 
factor"  to  adjust  for  importance  of  the  problem.  For  example: 

(type  of  establishment). 15  +  (type  of  service). 10  +  (weekly  meal 
volume). 90  +  etc.  =  risk  factor 
The  factors  chosen  for  the  Missoula  effort  were  selected  because  of  collection 
ease  and  the  apparent  risks  identified  by  each  factor.  It  is  expected  that 
this  formula  can  be  run  on  Missoula's  "intelligent  terminal," 

Currently,  the  Cascade  and  Missoula  hazard  ratings  are  to  be  considered 
experimental  only  and  each  will  be  analyzed  and  compared  to  determine  their 
respective  strengths  and  weaknesses  and  potential  for  wide-spread  use. 

Use  of  Data  -  If  either  or  both  of  the  experimental  hazard  formulas  is  deemed 
useful  by  administrators,  data  will  be  available  to  categorize  establishments 
fairly  and  consistently  so  that  variable  inspection  frequency  can  become  a 
realistic  tool  for  allocating  resources. 

Objective  3.  To  eliminate  all  4-and  5-point  items  found  during  inspection 
at  least  within  10   days  of  inspection  date. 

Rationale  -  Items  1,  3,  ^,  7,  11,  12,  20,  27,  28,  30,  31,  35,  and  kl   on  the  b, 

inspection  form  are  k-   and  5-point  items  and  are  considered  to  be  the  most  ^ 

critical  of  all  possible  violations.  Because  of  their  importance,  both  state  ^ 

rule  and  the  FDA's  Food  Service  Sanitation  Manual  have  set  a  10-day  correction  , 

limit.  Local  health  departments  have  tried  to  meet  the  10  day  goal,  but  in  ci 

many  cases  it  is  a  difficult  or  impossible  task.  ^ 

This  objective  is  meant  to  quantify  the  time  taken  to  correct  critical  items  S 
and  to  more  formally  examine  reasons  for  non-attainment. 
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Methodology  -  A  formal  protocol  will  be  esj^Hpihed  detailing  each  step  from 
marking  the  k-   and  5-point  violations  on  the'inspection  sheet  to  correction  of 
the  problem  (or  non-compliance,  if  applicable).  The  purpose  of  the  protocol 
is  to  formalize  the  compliance  procedure  and  to  serve  as  a  guide  and  training 
tool.  The  protocol  should  be  regarded  as  a  general  guideline,  but  it  is  re- 
cognized that  flexibility  must  be  allowed. 

In  order  to  track  outcomes  of  k-   and  5-point  violations,  each  sanitarian  g  '^ 

(X,  EX, 


will  keep  the  inspection  form  until  the  item(s)  are  corrected  (not  over  1^  ^  ^^ 
working  days)  before  routing  the  form  to  the  supervising  sanitarian  (or    ^^  '^ 
person  in  charge  of  reviewing  inspection  forms).  A  brief  note  must  accompany 
any  inspection  forms  where  ^-or  5-point  violations  were  not  corrected  within 
10  days  to  explain  the  reason(s)  and  give  an  estimated  schedule  of  correction. 

Use  of  Data  -  Objective  3  will  give  program  administrators  an  outcome  measure 
of  the  effects  of  restaurant  inspections  and  whether  or  not  the  10  day  require- 
ment is  workable  for  their  department,  as  well  as  give  them  a  record  of  problems 
of  non-compliance.  The  protocol,  which  should  be  updated  as  changes  occur 
in  local  or  state  regulations,  will  also  serve  to  assure  consistency  throughout 
county-wide  compliance  actions. 

Objective  4.  By  January  1981^   all  establishments  failing  to  meet  sanitation 
standards  or  who  have  shown  a^  decrease  in  at  least  2_  of  the 
past  3  regular  inspection  scores  will  have  enforcement  action 
taken. 

Rationale  -  Fair  and  consistent  enforcement  is  an  important  part  of  a  restaurant 
inspection  program.  This  objective  was  established  so  that  a  formalized  measure 
can  be  made  of  (1)  restaurants  who  fall  below  "adequate"  guidelines  and 
(2)  establishments  whose  inspection  scores  begin  to  show  a  decrease. 

Methodology  -  Either  by  using  the  SPIF  system's  historical  report  or  by  keeping 
historical  data  manually,  the  three  most  recent  inspection  scores  can  be 

examined  to  see  if  they  meet  or  exceed  established  standards.  The  standards      ;^ 

S 
to  be  used  will  be:  ^ 

1.  A  score  of  75  or  below  on  any  one  of  the  past  three  inspections.        ^ 

2.  Any  decrease  in  two  of  the  past  three  inspection  scores  and  one 
score  of  80  or  below. 

Establishments  falling  into  either  category  may  be  considered  "at-risk"  and 
the  protocol  (Objective  3)  may  then  be  followed  to  insure  correction. 
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At  the  due  date  of  this  survey  (January  I98I)  a  review  of  licensed  food 
establishment  files  (or  calling  up  the  appropriate  SPIF  report)  will  reveal 
restaurants  to  be  placed  under  corrective  action.  Those  files  should  then 
be  held  out  until  appropriate  action  is  taken. 

Use  of  Data  -  Using  the  standards  to  trigger  corrective  action  will  serve  to 
formalize  the  enforcement  part  of  the  Licensed  Food  Establishment  Program, 
to  identify  establishment  scores  which  are  falling  and  need  "preventive  en- 
forcement," and  to  show  administrators  the  number  of  establishments  which 
need  corrective  action  per  year  (or  quarter,  as  required). 

Objective  5.  To  explore  the  feasibility  of  conducting  a  program  to  determine 

the  incidence  of  foodborne  illness  in  the  oounty .  qj 

Rationale  -  Zaki,  et.al,^"^  noted  that:  f^ 

It  has  been  estimated  that  food  poisoning  ranks  second  only  t^ 

to  the  common  cold  as  the  most  frequent  cause  of  short-term  | 

illness  in  this  county.  However,  its  short  duration  and  pq 

mild  symptoms  in  the  majority  of  cases,  coupled  with  ^ 

extremely  poor  reporting,  have  hampered  the  implementation  co 

of  intensive  food  protection  programs.  § 

& 
The  traditional  problem  in  food  service  sanitation  has  been  how  to  (1)  pre-   q 

vent  and  (2)  deal  with  foodborne  Illness  when  often  the  source  can  never  be 

found  or  confirmed;  when  only  an  estimated  1%   of  afflicted  people  ever 

report  their  suspected  foodborne  Illness;  and  when  there  is  no  way  to  measure 

changes  in  illness  rates  with  changes  in  sanitation  programs.  In  fact, 

Bryan  went  so  far  as  to  say  that: 

Administrators  cannot  now  rely  on  the  change  in  incidence  of  food- 
borne disease  outbreak  in  a  community  to  determine  the  effective- 
ness of  foodborne  disease  prevention  activities. 

On  the  other  hand,  it  has  been  noted  that  the  public  expects  to  be  served 
safe,  appetizing  food  prepared  and  handled  in  a  sanitary  manner  in  a  clean 
establishment.  While  the  consumer  may  judge  an  eating  place  entirely  upon 
the  basis  of  observation,  the  consumer  also  views  the  health  department  as 
largely  responsible  for  both  environment  and  food  safety. 

Balancing  public  health's  effectiveness  and  public  demands  is  difficult  at 
best  and  good  data  is  sorely  needed. 

Methodology  -  The  communicable  disease  and  sexually  transmitted  disease 
portions  of  the  Community  Health  Services  Evaluation  Project  both  involve 
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A      research  reporting  systems.  In  that  system,  foodbome  illness  is  deemed  an 
immediately  reportable  disease  and, as  such,  is  to  be  reported  to  the  health 
department  by  phone  within  four  hours  of  diagnosis. 

Both  food  sanitation  and  communicable  disease  experts  will  be  polled  to 
determine  (1)  if  improved  and  sustained  reporting  is  possible  and  (2)  if 
yes,  what  methodologies  have  worked  for  others. 

In  addition,  a  small  group  of  emergency  room  and  other  physicians,  as  well 
as  their  office  staffs,  will  be  contacted  by  the  Health  Department  with  food- 
bome illness  information.  The  Health  Department  will  work  closely  with  this 
group,  especially  encouraging  them  to  report  enteric   disease,  to  be  com- 
fortable requesting  help  from  the  Health  Department  in  case  of  outbreak  investi- 
gation and  to  encourage  their  patients  (through  posters  or  peimphlets)  to 
report  suspected  food  illness.  Reporting  from  this  group  will  be  analyzed  to 
see  if  the  concentrated  efforts  have  paid  off  and  if  there  is  indeed  a  change 
in  numbers  of  suspected  or  real  foodbome  cases  reported  to  the  Health  Depart- 
ment. 

Use  of  Data  -  Increased  public  awareness  and  cooperation  in  all  events  of 
)—     foodbome  illness  (whether  real  or  suspected)  can  be  of  use  (1)  to  be  aware 
of  and  track  cases  back  to  establishments  with  sanitation  problems,  (2)  as 
a  long-range  measure  of  community  sanitation  and  changes  in  the  Licensed 
Food  Establishment  Program,  (3)  as  a  trigger  for  manager  and/or  employee 
training,  and  (h)   as  a  program  planning  and  resource  allocation  tool. 

Objective  6.  To  standardize  all  sanitarians  by  January  1981   so  that 

establishment  scores  are  within  807o   of  the  standardizer's 


score  I007o   of  the  time. 

Rationale  -  Standardization  is  importeint  to  (1)  program  administrators  so  that 
they  may  be  assured  that  their  sanitarians  are  conducting  restaurant  inspections 
in  a  consistent  and  fair  manner  and  (2)  sanitarians  who,  upon  standardization, 
are  given  the  opportunity  to  further  their  professional  expertise  as  well  as     "^^ 
the  assurance  that  if  they  change  areas,  their  inspections  will  be  uniform  and   P 
equally  impartial.  o 

The  general  goal  of  the  standardization  efforts  is  to  "conduct  inspections 
in  all  50  states  by  competent  and  qualified  sanitarians  who  consistently  and 


5.11 


Licensed  Food  Establishment 
Page  12 


fairly  apply  food  service  sanitation  rules."  (♦ 

Methodology  -  Using  the  current  ^4-item  inspection  form,  State  Food  and  Consiimer 
Safety  Bureau  personnel,  standardized  by  the  FDA  Regional  Food  Service  Specialist, 
will  be  scheduled  to  standardize  at  least  one  local  sanitarian  who  will  then 
be  responsible  for  assuring  standardization  of  the  department's  licensed  food 
establishment  staff.  The  Food  and  Consumer  Safety  Bureau  will  be  responsible 
for  checkingand  (if  necessary)  re-establishing  standardization  at  least  once 
per  year  to  insure  the  inspection  scores  are  maintained  at  appropriate  levels. 
In  addition,  the  SPIF  program  will  produce  reports  detailing  consistency  or 
variation  in  establishment  scores,  so  that  standardization  progress  can  be 
monitored  and  "relapses"  can  be  corrected. 

Use  of  Data  -  With  the  use  of  the  SPIF  program  or  by  manually  tracking  in- 
spection scores,  it  should  be  possible  to  track  and  note  overall  changes  in 
coiinty  (or  individual  restaurant)  establishment  scores  to  see  how  much 
standardization  has  changed  previous  levels  (Note:  Statistics  compiled  by  the 
Cascade  City-County  Health  Department  indicate  a  direct  relationship  between 
sanitarians'  workloads  and  their  average  inspection  scores.)  In  addition,        ^ 
after  standardization  is  accomplished  and  during  re-checks,  a  health  department 
is  reasonably  assured  of  consistency  and  accuracy. 

Objective  7.  To  determine  the  costs  of  conducting  the  Licensed  Food 
Establishment  Program. 

Rationale  -  As  with  other  parts  of  the  Community  Health  Service  Evaluation 
Project,  cost  data  is  consistently  rated  as  a  high  priority  for  program 
managers.  Many  agencies  are  caught  between  legal  and  professional  obligations, 
and  the  money  and  staff  limitations  of  conducting  the  myriad  of  public  health 
programs  today.  It  then  becomes  more  and  more  difficult  to  collect  accurate    s^ 
and  current  cost  information.  ti 


Methodology  -  Cost  worksheets  have  been  drawn  up  for  three  other  evaluations  — 
Sexually  Transmitted  Diseases,  Commimicable  Disease  and  Subdivision  Review. 
The  cost  computations  use  the  same  Overhead  Worksheet  and  similar  Cost  Work- 
sheets, so  it  will  be  easy  to  familiarize  staff  with  each.  The  worksheet  will 
cover  all  direct  and  indirect  cost  inputs  as  well  as  mileage  costs  and  cost 
of  using  the  SPIF  system. 
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Because  mileage  figures  are  hard  to  track  (sanitarians  often  conduct  five 
different  activities  per  day)  a  formula  will  estimate  licensed  food  establish- 
ment mileage: 

/licensed  food  establishment  salaries  ^   total   _  estimated  licensed  food 
total  environmental  health  salaries     mileage   establishment  mileage  cost 

Use  of  Data  -  Cost  data  is  required  by  program  administrators  as  a  means  of 
allocating  resources,  budgeting,  grant-writing,  public  presentations,  and 
legislative  and  budget  planning. 

Impliaations  of  Licensed  Food  Establishment  Evaluation  Model 
Because  the  Licensed  Food  Establishment  Model  will  be  able  to  be  generalized 
to  fit  individual  health  department  needs,  it  is  a  very  flexible  planning 
tool  and  as  such  can  be  changed  to  fit  other  health  department  needs.  Missoula's 
final  evaluation  results  will  be  available  to  any  administrator  who  would  like 
to  use  the  data  as  a  comparison  or  as  a  reference. 

The  evaluation  methodologies  described  are  designed  to  be  continued  from 
year-to-year  in  order  to  give  a  time  series  for  yearly  comparison.  As  staff 
become  familiar  with  the  procedures,  use  of  employee  time  will  diminish. 

There  is  a  fair  amount  of  evaluation  data  already  published  on  inspection 
frequency,  program  effectiveness  and  outbreak  analysis.  The  data  this  evaluation 
project  will  produce  should  be  added  to  the  already  existing  body  of  knowledge 
so  that  the  state  of  the  art  can  continue  to  grow. 


J.S.  Hand 
MCCHD 
May  1980 
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Bureau  of  Foods 

Division  of  F(x)d  Service,  HFF-220 

200  C  Street,  S.W.,  Room  3025 

Washington,  D.C.  20204 

Phone:  (202)  245-1508 
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an  automated 

data  processing  system  for 

food  service  sanitation  programs. 
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in-:  prog  rain  nt.'i'dr,  was  conducted  prior  lo  the  creation  (M 
Sl'ir ,  llie  s/;.t(!tn  was  tested  and  refined  in  a  real  lile  sel- 
ling    the  stale  ol  Maryland     lor  a  trial  year.  With  the  direct 
.issislance  f)l  Ihe  Maryland  program  personnel.  SPIF  was 
hirlher  tailored  to  the  vari(!ty  ol  user  needs  il  iiow  serves. 
Thf;  result  is  a  lotai  package  including  programmed  in- 
--.triiction  materials  lor  saniij'-ians.  and  Ihe  latest  system  ol 
modLilar  r;ompulor  programming  to  accommodate  polen- 
•lal  slate  initiated  mfidilicaiions  SPIF'  is  low  cost,  easy  to 
u.so  and  easy  to  ope'ale 

F  UA  IS  now  rr'aking  SPIF  available  to  stale  lood  service 
programs       Limited  technical  services,  software,  docu- 
mentation, training  materials  and  certain  start-up  and 
d'.'monslratif)n  co;.ls  can  l^e  provided  tjy  f-'DA  through 
( )pporiuniiy  Systems  Incorpoiaied  (OSI).  the  contractor 
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:.loi  may  pfovirie  Ihe  sialcs  v.'ith  on-site  briefings 
)  ()rrip,-ii'   ■-.tale  personnel  l(,'r  implementation 
^'cloped  a  complete;  trainiiKj  package  which  is 
Iho  '.anitarian.  iy-:[  is  an  e>-C'.:llent  primer  for  all 
in  aiiflio  visual  package  in(  iuding  a 
t!d  text  and  a  lape  cassette  tor  seff-instruction 
jiiais  are  presi.'nic-tt  using  k.iminology  with 
lanitarian  is  familiar  and  comfortable 


^:.;^»^? 


Jiyds 


A  complete  guide  to  SPK  ,  its  Ujatures  and  applications, 
has  been  prepared  kir  program  managers.  This  book  in- 
duces suggestions  tor  inpui/oulput  scheduling  (submis- 
sion of  forms  for  processing  and  production  and  distribu- 
tion of  reports),  estimates  ol  rnan-houcs  (or  SPIF  tasks, 
detailed  leport  descri[)ti(ins,  and  other  aspects  of  SPIF 
implementation 


'i^:U- 


,  that  r>iake  up  the  SPIF 


I  lu!re  are  ttireo  self  of  progr 

'.ystom  These  are 

■   The  Fieport  rioneiMtinrj  'V/sirm  (!)  progrnrris) 

•  The  File  fi^aintenance  System  [5  programs) 

•  The  Mailing  System  (2  programs) 

All  programs  aie  written  in  ANSI  (^OBOL  and  are  con 


-)Sl  harrlwr 


Further,  in  anticipa 


FDA  provides  on-site  start  up  assistance  througn  lea 
implementation"  This  means  that  both  maiiagorneni 
systems  consultants  from  OSI  provide  concentrated 
guidance  lor  participating  stales  in  supiiort  of  the  sp(> 
cialized  materials  descnliod  al)ove 


SPIF  produces  a  variety  (.)1  tables,  according  to  a 
frequency  which  can  be  dictated  by  progtam  needs.  Iile 
listings,  and  spociali/ed  letters  and  l.ibels  lor  mass 
mailings  SPIF  reports  are  aimed  at  ttiree  tier  prograni 
management  -  specific  report  distril)utions  vary  for 
sanitarians,  local  management,  and  state  management  at 
the  discretion  ol  participating  states.  The  folkiwing  are 
standard  SPIF  reports 

•  Establishment  Profile  Listing 

•.Report  on  Previous  Inspection  ftesults  for  Facli 

Establishment 
.--■VlistoriGal  Ir-ispection  Results  by  Establishment  lor 

Prescribed  Time  Periods 

•  Historical  Inspection  Results  by  Violations  lor  Each 
E.stablishment  (or  Presctitaed  Time  Periods 

•  Violation  Statistics  and  (he  Ratio  of  Violations  to  Numhe 
of  Inspections  lor  Each  Sanitarian 

•  Violation  Statistics  ,ind  Norm  Deviations  lr()m 
•Slate/County  Ratios  lor  Eacfi  Sanitarian 

•  Scoring  Levels  and  Workload  (in  terms  of  insp.;(.:tion 
types)  for  Each  Sanitarian 

•  Establishment  Violation  Statistics  for  Prescntied  Time 
Periods  by  Sanitarian  and  Locality 

•  Inspections  by  Type  of  Establishment  and  Type  of 
Inspection  lor  Each  Sanitarian 

•  Violation  Statistics  by  Most  Points  Lost  lor  Each  Violaiioi 
(or  Prescribed  Time  Periods 

•  Summary  Rank  Ordered  Analysis  of  Violation 
Frequencies 

•  Scoring  and  Inspection  Distributions  by  Weekly  Meal 
Volume 

•  Distribution  of  Establishments  by  Type  of  Service  and 
Weekly  Meal  Volume  lor  Each  CouhTy  ' 

•  Scoring  Levels  and  Inspection  Frequencies  by  Type  of 
Service 

•  Violation  Statistics  by  Type  of  Violation  for  Proscribed 
Tin-ie  Periods  (or  Localities 

•  Violation  Statistics  by  Category  of  Violation  (or 
Prescrilaed  Time  Periods  for  Localities 

•  Inspection  Frequency  and  Scoring  Levels  by  1  ypes  of 
Establistiment  (or  Localities 

•  Rosier  Of  (-f^taliJishmentsTo  Bo  Insiwctefl  Within  [ime 
Periods 

•  Listing  of  Establishment  Profile  Actions  and  Updates 

•  Listing  of  Inspection  Actions  and  Updates 

•  Various  Error  Listings 
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Food  Service  Establishment 
Profile  Form 


stablishcnent  l-D. 

County  j    Dist. 

Est.  No 

(1-10) 

Action 


Add  11-1      Delete 

Change         2     Acllvaii 


Sanit.  Code 

Census  Tract 

[12-141 

115-17l[   1  J 

f'TNnmeot  Establishment  ]~\    Tl    I     I     I    FT 

L'J  !«li. ilLliiiJJ. 


mmiim 


f  „1         Street  Address 
(42-65) 


8( 


City    (15-36] 


III 


mnimnniirniD 

mUTID 


!    .  1  Stattj  Coda 

i        i  i37-381 


Zip  Code 

[39-43! 


Activation  Date 

[44-491 


Type  ot  Establishment 
(50-52) 


1 


r»- 

Type  of  Service                                                               j 

a,  Sit-doiwn 

53-1 

b.  Cafeteria/Buffet 

2 

c.   Carryout  (fast  service) 

3 

ci.  Caterer  (comm.) 

4 

e.  Interstate  Conveyance 

5 

!»■ 

Weekly  Meai  Volume                                                      | 

a.   Less  than  500 

54-1 

b.  501-1,000 

2 

c.   1,CK31 -4,000 

.1 

d.  4,001-8,000 

4 

0.   Mote  than  8,000 

5 

|,0. 

Water  Supply                                                                   | 

a.   Public 

55-1 

b    Private 

2 

c.  Other 

3 

|„. 

Sev*age 

a.  Public                                                               56-1 

b.  Private                                                                   2 

c.  Other                                                                     3 

|,2. 

Permitted/Licensed 

a.  Yes                                                                57-1 

b.  No 

2      1 

F 

Certified  Manager 

a    Yes                                                                   58-1 

■ 

b.   No                                                                             2 

Inspection  Interval      1          f 
"•                i59-6li                1           1 

,,-     Secondary  l.D. 
"•    Code    [62-74] 

80  -(2; 
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Ms.    Janice    Hand 

Missoula   City-Coum.y  Health   Dept. 

:'>(i  I    W.    Aider 

Missoula,  Montana  59801 

Dear  Ms.  Hand: 

In  response  to  your  telephone  call  on  the  afternoon  o£  February 
2S,  with  regard  to  our  Food  Service  Inspection  and  Evaluation  Pro- 
j;iam,  T  submit  the  following  to  you. 

Witii  regard  to  the  different  groups  that  are  being  evaluated 
>' i  1  h  i  n  the  project:   GROUP  I  is  the  control  group  that  receives 
the  routine  inspection  of  twice  a  year.   GROUP  II  is  those  estab- 
iishments  that  are  inspected  on  a  quarterly  basis  and  GROUP  III 
js  the  in  depth  inspections  group,  which  are  inspected  twice  annuall)^ 
GROUP  TV  are  those  inspected  on  a  monthly  basis.  i. 

An  in-depth  inspection  would  consist  of  an  inspection  carried 
out  al  selected  intervals  during  an)'  given  day;  with  the  idea  to 
(iocuniont  the  kinds  of  problems  observed  during  the  many  operations 
ttiat  the  food  service  includes.   Therefore,  a  spot  check  of  the 
establishment  for  one  hour  at  eight  o'clock  in  the  morning  might 
be  followed  up  with  a  visit  during  the  lunch  hour,  then  again 
around  four  or  five  o'clock  and  possibly  another  check  into  the 
establishment  in  the  evening.   The  questions  we  hope  to  answer  with 
tlie  in-depth  inspection  are:   Do  the  in-depth  inspections  provide 
additional  information  that  is  useful  in  improving  sanitation,  and 
reducing  the  risk  of  illness?   Do  inspections  conducted  in-depth 
result  in  high  demerit  scores?   Do  in-depth  inspections  provide  a 
greater  benefit  to  some  kinds  of  establishments  more  than  others? 
Do  in-depth  inspections  provide  for  an  increase  in  the  long-term 
sanitation  level?   And  finally,  is  the  current  inspection  form 
suitable  to  accurately  record  the  results  on  in-depth  inspections? 
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The  determination  of  a  hazard  rating  for  an  establishment  is 
simply  an  additional  assessment  of  those  items  on  the  inspection 
<,  hock  list  that  directly  contribute  to  food-borne  illness.   Gen- 
cM-a  1  i  y ,  those  fac':ors  arc  listed  in  tlie  CDC  information,  and  basi- 
cally refer  to  ihe  items  1-13  on  the  new  food  service  form.   For 
example,  if  Item  3  were  in  violation  on  an  inspection  and  it  was 
Ihe  only  violation  reported,  the  normal  rating  score  would  be  a 
•»S.   If  it  were  determined  that  Item  3  were  in  violation  in  three 
tliffcrent  areas  within  the  food  establishment,  then  they  would  be 
given  a  hazard  rating,  based  on  the  original  rating  plus  the  addi- 
tional incurred  violations  on  the  first  13  items.   Therefore,  haz- 
ard rating  is  equal  to  the  demerit  score  (in  terms  of  the  numbers 
subtracted  from  100)  plus  the  weighted  additional  items  of  the 
first  thirteen  items.   A  typical  report  would  be  as  follows:   rating 
score:   85;  therefore,  the  number  of  demerits  would  be  15  plus  addi- 
tional weights  from  multiple  violations  of  the  first  13  items; 
therefore,  if  item  3  were  in  violation  on  two  occasions  within  the 
establishment,  then  the  rating  score  would  be  85  and  the  hazard 
rating  would  be  20. 

The  hazard  potential  of  an  establishment  is  done  on  the  enc^  ^ed 
rating  form.   In  general,  under  extend  of  potentially  hazardous 
food  served;  they  get  1  point  if  they  have  milk  or  milk  products, 
additional  point  if  they  have  eggs,  additional  point  if  they  handle 
meat  T,  poultry,  additional   point  if  they  have  fish  or  shell  fish, 
and  additional  point  if  they  have  other  ingredients  capable  of  sup- 
|)orting  rapid  and  progressive  growth  of  micro-organisms.   There- 
fore, a  fast-food  place  that  serves  only  hamburgers  and  milk  pro- 
ducts would  only  be  given  a  two  for  the  extent  of  potentially  haz- 
ardous food  served. 

Extend  of  handling  and  preparation  of  potentially  hazardous 
foods:   all  food  establishments  will  receive  one  for  receiving 
potentially  hazardous  foods  in  any  form  and  storing  it  in  their 
licensed  premises.   If  food  is  stored  in  its  most  static  state, 
no  additional  points  are  assigned.   (Static  state  shall  mean  covered, 
frozen,  dried.)   If  any  food  is  refrigerated,  an  additional  point 
is  given. 

Three  -  an  additional  point  is  given  for  a  change  of  state  of 
any  food,  frozen  meat  thawed,  canned  food  opened,  dried  food  re- 
constituted.  Raw  to  cook  does  not  count  as  a  change  of  state. 

Four  -  incorporation  of  any  product  into  a  recipe  receives  a 
point. 
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l-'ive  -  restoragc  of  ^  prepared  product  receives  a  point. 

Six  -  storage  of  service  at  hot  or  cold  temperatures,  J.e., 
snlfid  bars,  steam  tables  for  more  than  one   hour,  receive  a  point. 

Hours  of  operation  -  All  points  arc  assigned  as  follows: 
Less  than  eight  hours  -  one  point;  eight  hours  -  two  points;  be- 
tween eight  and  twelve  hours  -  3  points;  twelve- txventy  -  four  hours - 
four  points;  twenty- four  hours  -  five  points. 

P(M-sons  served  is  hard  to  calculate..   I  think  that  generally 
one  can  got  an  idea  of  whether  they  arc  high  or  low  volume  es- 
(  al' I  1  ^h-ncnTs  and  rate  them  accordingly. 

Maintenance  demands  of  facility  and  equipment  answers  the 
following  basic  questions: 

To  wliat  extent  is  the  facility  suited  for  the  function 
that  it  is  trying  to  perform  and  Are  there  serious  struc 
tural  and  facility  problems  that  demand  a  lot  of  main- 
tenance -  cleaning  and  other  activities  that  subtract 
time  from  those  efforts  that  need  to  be  directed  toward 
the  food  operation.   This  is,  of  course,  somewhat  subjec- 
tive too,  but  we  feel  that,  for  example,  a  small  estab- 
lishment with  old  equipment  that  is  trying  to  put  out  a 
full-scale  menu  and  has  numerous  structural  problems 
should  receive  the  maximum  of  five  points. 

The  final  factor  used  in  assessing  establishment  performance 
is  called  a  Performance  Rating  or  Performance  Ratio.   Tliis  is  the 
hazard  potential  (HP)  divided  by  the  hazard  rating  (HR) .   For  ex- 
ample, if  the  HP  is  17  and  the  HR  is  24,  the  performance  ratio 
(PR)  is  .71.   (17/24  =  .71)  as  the  HR  decreases  the  PR  increases. 
The  performance  ratio  is  a  valuable  and  objective  tool  in  planning 
and  programming  an  assessment  of  a  food  service  program,  since 
it  provides  more  meaningful  information  about  an  establishment. 
It  appears  that  in  looking  at  the  hazard  potential  and  performance 
ratio,  the  hazard  potential  dif f irentiate  betv/een  those  establish- 
ments with  the  greatest  potential  for  a  problem  and  the  performance 
ratio  indicates  those  establishments  with  the  greatest  probability 
for  a  food  borne  iilness  problem.   The  performance  ratio  allows  for 
determining  which  establishments  need  more  attention,  allows  for 
a  comparison  of  the  establishments  regardless  of  type  and  allows 
for  an  assessment  of  the  total  food  service  program  on  an  annual 
basis . 
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I  hope  this  has  been  of  some  value.   Please  remember  that 
this  )ro!ect  is  highly  experimental  at  tiiis  point  so  there  may 
he  numerous  improvements  and  refinements  forthcoming.   A  statistJ- 
cal  .-pa  lysis  has  yet  to  be  done  on  the  four  groups.   Please 
c'on'-icL  this  department  if  we  can  be  of  further  assistance. 

'in- 
sincerely, J- 

CITY- COUNTY  BOARD  OF  HEALTH 


i  jS&L     '''l-Y  i^I'^ 

Peter  M.  Frazler 

Environmental  Health  Coordinator 

>M!7al 
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